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Foreword 



Control systems and feedback loops are ubiquitous in engineering, in areas such 
as aerospace control, manufacturing and robotics, active damping, climate control 
of buildings, process control in chemical plants, electrical power systems, bioengi- 
neering, consumer products, and active suspensions, automatic braking systems, and 
engine timing in the automobile industry. One finds control and feedback in nature 
as well, for example, in the homeostatic mechanisms that allow organisms to finely 
tune their internal variables such as temperature, pressure, or chemical levels. 

The field of mathematical control theory concerns itself with the basic theoretical 
principles underlying the analysis of feedback and the design of control systems. It 
differs from the more classical study of dynamical systems in its emphasis on in- 
puts (or controls) and outputs (or measurements). Linearized analysis of systems is 
the basic foundation of most practical control engineering and has been phenome- 
nally successful. Nonetheless, linearization techniques can only deal with "small" 
deviations from desired behavior. Thus, the development of tools appropriate to the 
"global" study of systems with inputs and outputs has been the focus of a major 
research effort since at least the early 1970s. 

In the late 1980s, there emerged a novel paradigm for nonlinear system analysis, 
based on the notions of "input-to-state stability" and several variants, which allow 
a seamless integration of classical Lyapunov-like stability theory with input/output 
operator approaches. The program of research that ensued has as its ultimate goal 
a complete formulation of the foundations of nonlinear behavior in two dual ways: 
the analysis of given systems in terms of these notions and the use of these notions 
in the form of systematic design tools which assign desirable properties to feed- 
back systems. This duality between analysis and design is well summarized by the 
authors' maxim: "for every method of proving global stability, there is a correspond- 
ing method of nonlinear feedback design," and the book systematically applies that 
principle. 

An original and very valuable aspect of this monograph is its treatment not only 
of ordinary differential equation systems, but also of delay and more general func- 
tional differential equations, as well as allowing a study of time-varying systems 
through "nonuniform" stability notions. Another original feature of the book is that 



viii Foreword 

ISS and its variants are extended to various important classes of interconnected sys- 
tems using small-gain theorems. This duality between ISS (for single systems) and 
small-gain (for coupled systems) plays a key role in addressing the problems of 
robust stability and stabilization. 

The field is still active and full of open problems, and this monograph should 
encourage much further research and further development of applications, many of 
which are discussed here. The authors of this volume have been two of the main 
contributors to the program, and in this book they provide a detailed and rigorous 
introduction, suitable for beginning graduate students as well as for more experi- 
enced researchers who wish to transition to the field. 

Piscataway, NJ Eduardo Sontag 



Preface 



Phenomenal progress in nonlinear systems theory has been made during the last 
decades. It has been reflected in two aspects. On the one hand, internal and external 
global stability notions have been studied intensely for uncertain nonlinear systems. 
On the other hand, the applications of these advanced stability results to control 
engineering systems have led to numerous novel methodologies for the design of 
nonlinear feedback controllers. It is fair to say that input- to- state stability (ISS), 
a notion invented by E.D. Sontag in the late 1980s, plays an influential role in the 
work of many researchers including the authors of this book. ISS has bridged the gap 
which previously existed between the input-output and the state-space methods, two 
popular approaches within the control systems community. Roughly speaking, the 
importance of ISS for the study of nonlinear systems is reflected by the intriguing 
fact that it captures two main stability notions: Lyapunov stability (i.e., the behavior 
of the zero-input response with respect to nonzero initial conditions) and input- 
output stability (i.e., the behavior of the zero-state response with respect to nonzero 
external inputs). 

Nonlinear systems are encountered frequently in almost all branches of science 
and engineering. In fact, in engineering, physics, economics, and biology, nonlin- 
earity is the rule, and linear systems are rare (which almost exclusively exist only in 
our computer programs). Despite the importance of nonlinear system theory, grad- 
uate students or researchers in mathematics, engineering, physics, economics, and 
biology often have difficulties in taking advantage of recent advances in mathemat- 
ical systems and control theories. There are several excellent textbooks that provide 
nice introductions to nonlinear systems theory, but many recent stability results are 
scattered in the vast literature. Motivated by this observation, we set our hands to 
write this monograph about a year and half ago. The specific objectives of this book 
are described in the following. 

The first aim of the book is to provide the basic knowledge needed for a graduate 
student in order to be able to understand the current research in nonlinear stability 
theory and nonlinear control theory. A relatively high level of mathematical back- 
ground is assumed: the reader is required of having basic knowledge in differen- 
tial equations, calculus, and real analysis. Measure theory is not needed (although 
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measurable functions are met even in the first pages of the book): the reader can 
replace "measurable" functions by "piecewise continuous" functions. The book is 
self-contained in the sense that all results are proved in detail by using basic math- 
ematical knowledge and other results presented in the book. Only global stability 
notions are studied in the present book. It should be mentioned that there are many 
important results about local or regional stability in the literature. 

The second aim of the book is to give a perspective of nonlinear stability theory 
and nonlinear control theory that is not frequently encountered in the literature. The 
idea can be stated in the following (informal) way: 

"/or every method of proving global stability, there is a corresponding method of 
nonlinear feedback design'' 

Therefore, the book is designed to help the reader to understand this one-to-one 
correspondence. In the first five chapters the reader is introduced to internal and 
external stability notions and characterizations. Necessary and sufficient conditions 
for each stability notion are provided, and a description of the various methods for 
proving stability is presented. Finally, in Chaps. 6 and 7 of the book the reader is 
introduced to the various methods of nonlinear feedback design. Each method aims 
to design a feedback law such that the resulting closed-loop system is "stable." The 
proof of the stability properties of the closed-loop system is performed by using one 
particular method of proving stability. We believe that this perspective can help the 
reader to understand the proposed feedback design methodologies and can inspire 
the reader to suggest new ones. However, for want of space, some methods of prov- 
ing stability and feedback design are only briefly mentioned (e.g., the method of 
using Matrosov's theorem). 

The third aim of the book is to show that the same mathematical tools, up to mi- 
nor modifications, can be used for all kinds of systems. Working within an abstract 
system-theoretic framework, one can see that systems described by Ordinary Differ- 
ential Equations (ODEs), systems described by retarded functional differential equa- 
tions (RFDEs), systems described by coupled retarded functional difference equa- 
tions and retarded functional differential equations, and sampled-data systems can 
be analyzed and studied using (almost) the same tools. We believe that this feature 
is important: many recent contributions to nonlinear systems theory are developed 
for complex dynamical systems other than those described by ODEs. Furthermore, 
it has been recognized that feedback laws of new kinds (e.g., feedback laws with 
delays, hybrid/switching feedback laws) can give rise to features for the closed- 
loop system that cannot be encountered in systems described by ODEs. In such 
cases, the closed-loop system in question becomes a system with different mathe- 
matical description from the original open-loop system. Time-varying systems are 
not excluded: the proposed system-theoretic framework can capture all features of 
time-varying systems (e.g., nonuniform stability phenomena). 

As the fourth and last aim of the book, it is the authors' view that nonlinear 
systems theory has reached a level of maturity which can provide interesting con- 
tributions to other areas of applied mathematics. There are many results and exam- 
ples in the book that illustrate the use of nonlinear systems theory to game theory. 
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fixed-point theory, numerical analysis, and (only superficially) mathematical biol- 
ogy. Some open problems are listed in the last Chap. 8 with a unique objective to 
entice the reader, in particular graduate students, to develop their novel ideas and 
techniques, which will contribute to the further development of modern mathemati- 
cal control theory. 

The list of people who must be acknowledged for their support and help to the au- 
thors' research is too long to be given. I.K. would like to thank Professor Panagiotis 
Christofides for his help and good advice that he gave to him when he was a student. 
Professor John Tsinias has been the academic mentor for lasson Karafyllis; he owes 
major gratitude to him that cannot be expressed in a few words. Professors Stelios 
Kotsios, Eduardo D. Sontag, and Costas Kravaris helped I.K. very much in the first 
steps of his academic career (each one in a different way). I.K. also owes gratitude 
to Professor Zhong-Ping Jiang for being one of the first persons who believed in 
him (and does not mind if it is not right for one author to write acknowledgments 
for a coauthor!). Z.P.J, would like to thank all his coauthors for contributing to this 
book, directly or indirectly. Special thanks go to his Ph.D. advisor Laurent Praly for 
having introduced him to the field of nonlinear control and his two Australian men- 
tors David Hill and Iven Mareels for their long-lasting influence in his career. Z.P.J. 
also would like to thank Professors A. Isidori, P.V. Kokotovic, and E.D. Sontag, and 
President Jerry Hultin of the Polytechnic Institute of New York University, for the 
high expectations they set on him, explicitly or implicitly. Yes, it is also a pleasure 
to thank his nonlinear control friends Jie Huang, Miroslav Krstic, Andy Teel, and 
Yuan Wang for the moral support over the past years. Finally, the authors would like 
to thank their students, in particular Yu Jiang, for helping with the typesetting of the 
book and the drawing of some figures. In the end, all possible errors and typos in 
the book remain to be the sole responsibility of the authors. 

Last but not least, both authors would like to thank their families (Christina, 
Katerina, Olympia and Xiaoming, Jenny, Jack) for their understanding, support, and 
patience during the long period when the book was written. 

Chania, Greece lasson Karafyllis 

New York, USA Zhong-Ping Jiang 
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9i The set of real numbers 

SK"'" The set of nonnegative real numbers 

SR!j_ The set of «th-order vectors of which each component is nonnegative 

N The set of natural numbers 

Z The set of integers 

Z"*" The set of nonnegative integers 

\x I Euclidean norm of a vector x efR" 

x' The transpose of a vector x e M" 

x-i The vector obtained by deleting the ith component of a vector x e Df", 

with n >2 
g^« xm -pjjg space of real matrices with dimensions n x m 

A' The transpose of a matrix A e jyt"^™ 

A~^ The inverse of an invertible square matrix A e ;)t"^" 

/ Generic notation of an identity matrix 

int(A) The interior of a set A C !)i" 
K^ The class of positive continuous functions on di'^ 

M A function a : d\~^ —> di~^ is of class A/" if a is continuous and 

nondecreasing with a (0) = 
Pru(x) The projection of x e Dt" on a convex set U c S)f' , i.e., the unique 

vector y such that |x — yl = minj,gc/ |x — m| 
p.d. A function f : A ^ 9^+, where A C Sli" with e A, is positive definite 

(p.d.) if /(O) = and f{x) > for all x e A\{0} 
r.u. A function / : A ^ 9^+, where A C ;)i" is a nonempty and unbounded 

set, is said to be radially unbounded (r.u.) if, for every a > 0, the level 

set {x e A : f(x) < a] is bounded 
supp(/) The support of a function f : A —> ^\, where A C Dt" 
X < y For a pair of vectors x , y e M" , we say that x < y if and only if 

(y-x)emi 
Mn A function p : iR^ -^ iTt"*" is of class Afn if p is continuous with 

p(0) =0 and such that p(x) < p(y) for all x, y e Sli'l with x < y 



xviii Notations 

[V\t,,t] For f > fo > 0, let [to, t]3x^ V{x) = (VKt), . . . , V„{x))' e 5R" be a 
bounded map. We define 

[y\toj] := (sup^e[fo,r] ^l(^)' ■ ■ • ' sup^e[fo,'] ^n(^))' 
r(^) We say that r : m\ -^ ilt!;! is nondecreasing if r{x) < r(y) for all 

x,y & 9t!j_ with x < };. For any positive integer k, we define 
r^*^(x) — r o r o ■■■ o r {x). By convention, we set r*°^(x) =x, for 

k times 

all X e S)f; 

I We define 1 = (1, 1, . . . , 1)' e m". If m, u e 9{ and m < u, then 1m < Iv 
K A function a : di~^ —> di~^ is of class A" if a is continuous and increasing 

witha(0)=0 
Kqc a function a : M~^ -^ M~^ is of class Koo if it is of class K and satisfies 

KL A function p : !1t+ x 9t+ -^ m+ is of class KL if, for each t > 0, the 

mapping cr(-, t) is of class K, and, for each s >0, the mapping p{s, •) 
is nonincreasing with lim^^+oo Pi^, t) = 

£ The set of nonnegative continuous functions fi : di'^ -^ di'^ with 

lim^^+oo m(0 — and /q °° /x(r) d? < +oo 

II • ||;f The norm of the normed linear space X 

5{/[0, r] The intersection of U c. X with the closed sphere of radius r > 0, 
centered atOeU, i.e., Bu[0, r] := {u e U; \\u\\x < r} 

Wix, y)\\c Unless specified otherwise, the linear space C — X x y, where X and 
y are normed linear spaces, is endowed with norm 

ll(^,3')l!c=yikll^ + lblly,forall(x,>')eC 

M{U) The set of all functions u:dl+^U 

Mo The identically zero input, i.e., uo(t) = e U for all r > 

C°^(I; A) The set of Lebesgue measurable and essentially bounded functions 

M : / ^ A for an interval / C 5R and a set A C Of 
C^il; A) The set of Lebesgue measurable and locally essentially bounded 

functions u: I ^ A for an interval I C.'dX and a set A C ;)i" 
{TJlj^O ^ partition n — {TII^q of 0{+ that is an increasing sequence of times 

with Tq — Q and 7; -^ +oo. Its diameter is defined as 

suplT^+i - Ti\ i =0, 1,2,...} 
qjiit) For every partition n — {7;}?^q of Dt^, qnit) :— min{r e tt; f < T} 

C'^(A; Q) The class of continuous functions on a subset A of a normed linear 

space X, taking values in a subset ^ of a normed linear space y 
Tr{t)x The "r-history" of a function x : [a — r, b) —> fR" at time t e [a,b), for 

constants b > a > — oo and r > 0. That is, Tr(t)x maps 6 e [— r, 0] to 

x(t + e) 
\\x\\r Forx : [— r, 0] -^ di", \\x\\r :— supgg|-_^_o] k(^)l 

q.c. A function / : (x, m) e A x U ^^ f(x,u) e Dt, where A C <Y, A' is a 

normed linear space and U c iJi'" is a convex set, is said to be 

quasi-convex (q.c.) with respect to u e U if the inequality 

/(x, aui + (1 — a)u2) < max{/(x, mi), /(x, M2)} holds for all x e A, 

Ml, M2 e [/, and a e [0, 1] 
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c.c. A mapping / : (f , x) e T x A ^ f{t, x) e W , where T — Z"*" or 

T = S)^"'", Ac. X, and A" and W are normed linear spaces, is said to be 
completely continuous (c.c.) with respect to ;«: e A, written as 
f e CU(T X A; W), if for every pair of bounded sets / C T and 
S c. A, f maps I x S into a bounded set and, additionally, for every 
e > 0, there exists S > such that \\f(t, x) — f(t, y)\\w < s for all 
t e I and x, y e S with \\x — y\\x < S 

c.1.1. A mapping f : (x,d) e X x A ^ f(x, d) e W, where A<zy, and X, 

y, and W are normed linear spaces, is said to be completely locally 
Lipschitz (c.1.1.) with respect to x e A:" if, for every pair of bounded sets 
S (ZX and G c A, there exists L > such that 
\\f{x,d) — f{y,d)\\y/ < L||x — y\\x for all x, y e S and J e G 
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Chapter 1 

Introduction to Control Systems 



1.1 Introduction 

This chapter is devoted to the analysis of certain crucial notions in mathematical 
control theory: 

• the notion of a deterministic control system 

• the notion of a robust equilibrium point 

• the notion of the feedback connection of control systems 

• the notion of the transformation of control systems. 

The above notions are presented in a system-theoretic framework which allows 
the study of various classes of systems that arise in physics, biology, economics, and 
engineering. Then, it is shown that, under mild assumptions, the following important 
classes of control systems: 

• control systems described by ordinary differential equations 

• control systems described by retarded functional differential equations 

• control systems described by coupled retarded functional differential equations 
and functional difference equations 

• control systems described by functional difference equations 

• control systems with variable sampling partition 

satisfy our requirements of a deterministic control system with the Boundedness- 
Implies-Continuation property and a robust equilibrium point. Finally, it is shown 
that discrete-time systems can be cast in the proposed system-theoretic framework. 



1.2 Examples of Control Systems 

We next present some examples of control systems. The examples are qualitatively 
different because the mathematical formulation of the model of each system is dif- 
ferent. However, all examples show that there are common points, which can be used 
in order to treat them in the same way. We begin with the first class of continuous- 
time control systems described by ordinary differential equations. 

I. Karafyllis, Z.-P. Jiang, Stability and Stabilization of Nonlinear Systems, 1 

Communications and Control Engineering, 
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1.2.1 Control Systems Described by Ordinary Differential 
Equations (ODEs) 

Let U c ;it"', D C !1t', with e U. Consider two locally bounded mappings / : 
9t+ X !1t" X [/ X D ^ !){" and H : !){+ x M" x U -^ m'' with //(r, 0, 0) = and 
/(f , 0, 0,d) — for all (f , cf) e S)i+ x D that satisfy the following hypotheses: 

(HI) The mapping (x,u,d) ^^ f{t,x,u,d) is continuous for each fixed f > 0, and 
there exists a symmetric positive definite matrix P e J){"^" such that for every 
bounded / C J){+ and for every bounded S <ZM" x U, there exists a constant 
L > such that 

(x - y)'P{f{t, X, M, d) - fit, y, u, d)) <L\x- y\^ 
for all re/, (x, u,y,u) & S x S, and d e D. 

(H2) The mapping t ^^ f(t,x,u,d) is Lebesgue measurable and locally essentially 

bounded for each fixed {x,u,d) ed\" x U x D. 
(H3) There exist functions y e K^ and a e A'oo such that \f{t,x,u,d)\ < 

Y(t)a(\x\ + \u\)foT all {t,x,u,d)em+ x 9f' xU x D. 
(H4) The mapping H : 9^+ x 9t" x U ^ D{*^ is continuous. 

Remark 1.1 It is of interest to note that Hypothesis (HI) is equivalent to the exis- 
tence of a continuous function L : i)t+ x !){+ —^ 9i+ such that, for each fixed f > 0, 
the mappings L(t, ■) and L(-, t) are nondecreasing, satisfying the following inequal- 
ity: 

(x - y)'P{f{t, X, u, d) - fit, y, u, d)) < L{t, \x\ + \y\ + \u\)\x - y\^ 
for all it, X, y, d, u) e 9{+ x 9{" x m" x D x U (1.1) 

Let Mf/ and Mo denote the sets of Lebesgue measurable and locally essentially 
bounded functions u : St"*" —>■ U and d : 91+ -^ D, respectively. 

Clearly, by virtue of Hypotheses (Hl-3) above and Lemma 1 on p. 4 of [11], 
for every id,u) e Md x Mu , the composite map fit,x,uit),dit)) satisfies the 
Caratheodory conditions on Dt"*" x W . Consequently, by application of Theorem 1 
on p. 4 of [11], for every (fo, XQ,u,d) e ?){+ x iU" x Mu x Md, there exist /z > 
and at least one absolutely continuous function x : [t{),to + h\ -^ M" with x(fo) = xq 
such that x(?) = /(f , x(f), M(f), dit)) almost everywhere on [to, to + h]. 

Let X : [to,to + h] -^ ■!{" and y : [to,to + h] ^ !){" be two absolutely continu- 
ous functions with initial conditions x(fo) = xq and y(fo) — yo, respectively, that 
satisfy x(f) — fit,xit),uit),dit)) and >>(?) — fit,yit),uit),dit)) almost every- 
where on [fo, fo + h]. Evaluating the derivative of the absolutely continuous map 
zit) = (x(f) — yit))' Pixit) — yit)) on [to, to + h] in conjunction with Hypothesis 
(HI) above, we obtain the integral inequality 

\xit)-yit)f <-^\xito)-yito)\~ + -7r- / L\xir) - yir)f dr 
Wt e[to,to + h] 
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where L :— L{tQ+h,a{x, y, u)), L(-, ■) is the function involved in (1.1), A"!, ^"2 > 
are constants that satisfy K[ |xp < x' Px < K2\x\^ for all x e !){", and a(x, y, u) :— 

suPre[,o,,o+/i] l-^^^^l + sup,s[,(,.,o+/,] \y{t)\ + ^^Vte[toJo+h] l«(OI- A direct application 
of the Gronwall-Bellman inequality gives 

\x{t)-y{t)\<l^\xo-yo\&xJ—{t-to)\ for all f e [ro, fo + /z] (1-2) 

Thus, we conclude that under Hypotheses (Hl-3), for every (fo, xq, d, u) e fft"*" x 
St" X Md X Mf/, there exist h >Q and exactly one absolutely continuous function 
x : [to, to + h]^ ;)i" with x(to) — xq such that x(t) — f{t, x{t), u(t), d{t)) almost 
everywhere on [ro, fo + ^]- Using the fact that the mapping / : D{+ x i){" x C/ x D — >• 
Of is locally bounded, Hypotheses (Hl-3) above, and Theorem 3.2 in [14], we 
conclude that, for every (fo, XQ,u,d) e i)}"*" x W x Mo x Mjj , there exists fmax e 
(fo, +00] such that the unique solution x{t) of x(t) — f(t,x(t), u(t),d{t)) with 
x(to) — XQ is defined on [ro, fmax) and cannot be further continued. Moreover, if 
fmax < +00, then we must necessarily have limsup,^,- |jc(r)| — +00. 

Thus, for every (fg, XQ,u,d) e fl{+ x S){" x Mo x Mu, the unique solution x(r) of 
x(t) — fit, x(t), u(t), d(t)) with x(to) — XQ and the output trajectory Y(t) satisfy 
the following equations a.e.: 

x(t) — f{t, x{t), u(t), d(t)) 

Y{t) = H{t,x(t),u(t)) 

xit) e or, Y{t) e a{^ u{t) e U, dit) e D (1.3) 

We next provide an example of a biological system which takes the form (1.3) and 
satisfies Hypotheses (Hl^). The example shows that it may be necessary to make 
certain manipulations in order to be able to satisfy Hypotheses (Hl-4). 

Example 1.2.1 Consider the chemostat with one microbial species and one nutrient 

(see [45]): 

X{t)^{li{s(t))-D{t)-b)X{t) 

m = D(t){sinit) - s(t)) - K{s(t))t^{sit))Xit) 

X(t)>0,s{t)>0 (1.4) 

The concentration of the microbial species is denoted by X{t), s(t) denotes the con- 
centration of the nutrient, Sin(t) > denotes the inlet concentration of the limiting 
nutrient, and D(t) > denotes the dilution rate. The specific growth rate /x(.v) of the 
microbial species is a locally Lipschitz, bounded function fx, : [0, +00) —>■ [0, +cxd) 
with /i(0) = and fi(s) > for all s > 0. The constant b >Ois the mortality rate of 
the microbial species, while the locally Lipschitz function K : [0, +cx)) -^ (0, +00) 
is the (possibly varying) yield coefficient. 

System (1.4) is a system described by ODEs. However, it does not satisfy all 
requirements described by Hypotheses (Hl-3). First of all, the set where the state 
variables take values is not the Euclidean space !){^. In order to be able to recast 
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system (1.4) to the form of a system which satisfies Hypotheses (Hl-3), we assume 
the existence of (X*, s*,D*, j* ) e (0, +oo) x (0, +oo) x (0, +oo) x (0, +oo) with 

li{s*)^D*+b K{s*)ii{s*)X*^D*{s*„-s*) (1.5) 

and we apply the transformation: 

X = X* exp{xi) s = s* sxp(x2) D — D*{l+ui) Sin—s*^+s*U2 (1.6) 

It follows from (1.5) and (1.6) that system (1.4) is described by the following differ- 
ential equations: 

XI = D*{g(X2) -Ml) 

i2 = £)*exp(-X2)[M(l - /7(x2)exp(xi)) - RMp(x2)g(x2)e\pixi) (1.7) 
+ 1 - exp(x2) + M2 + Mi(M + 1 + M2 - exp(x2))] 
where g(x2) := M(^-expte))-M(.-) ^ ^^^^^ .^ ^^^^f^, R := j^,, and M := 

'" «' . Notice that by virtue of (1.5) and previous definitions, the transformed sys- 
tem (1.7) now satisfies Hypotheses (Hl-3) with x — (xi, X2)' e !){^, u — (ui, M2)' e 
[/ = [-1, -I-CX3) X [-M, -1-00). 

In this case, d(t) is irrelevant. Moreover, we define the output map Y — 
(xi , X2)' = X to be the identity map. 

Let (j) : A^ ^ i){" be the mapping 4>(t,to,xo,u,d) :— x(t) which for each 
(to, XQ, d, u) e ?){+ X iK" X Md x Mu and t e [to, fmax) gives the value x{t) e 9t" 
of the unique solution of i(r) — f(t,x(t), u(t),d{t)) withx(fo) — xq. The mapping 
(/) : A^ ^ at" is defined on the set A^ = U(ro,.vo,«,rf)e3i+x;i!"xMt,xMfl[fo, Wx) x 
{(fo, xo, M, cf)}. It should be clear from all the above that the mapping : A^ — ^ 9t" 
is well defined and satisfies the following properties: 

(1) Existence: For each (fo, xq, d, u) e i){"'" x 9i" x Mq x Mj/, there exists ? > fo 
such that [?o, ?] x {(fo, xq, m, c?)} C A^. 

(2) Identity Property: For each (ro, xq, cf, m) e 9{+ x i)i" x Mo x Mu, it holds that 
0(?o, t{),XQ, u,d) —XQ. 

(3) Causality: For each (t,to,xo,u,d) e A^ with f > fo and for each {ii,d) e 
Mu X Mz) with (M(T),J(r)) = (M(r),(i(T)) for all r e [to,t], it holds that 
(t, tQ, Xq, u, d) e Aff, and (p(t, ?o, xq, m, (i) — (p(t, ?o, xq, m, d). 

(4) r/ze '"Boundedness-Implies-Continuation" (BIC) Property: For each quadruplet 
(fo, Xq, M, fif) e DJ"*" X 9{" X Mu x M/), there exists a maximal existence time, 
i.e., there exists fmax e (^o, +00] such that [tQ, /max) x {(ro, xq, m, rf)} C A^, and 
for all f > fjuax^ it holds that (t, tQ, xq, u, d) ^ A^. In addition, if f^ax < +00, 
then for every M > 0, there exists t e [Iq, fmax) with \<pit, Iq, XQ,u,d)\ > M. 

(5) The Classical Semigroup Property: For each t e [tQ, ?max), it holds that, for all 
r e [tQ, t], (p{t, X, <p{x, tQ, XQ, u, d), u, d) — (pit, tQ, xq, u, d). 
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1.2.2 Control Systems Described by Retarded Functional 
Differential Equations (RFDEs) 

Let D C 9i' be a nonempty set, and U c i1{™ a nonempty set with e U. Also 
consider locally bounded mappings / : ;){+ x €"([— r, 0]; SW") x U x D ^ i){", 
H : St"*" X C^([—r, 0]; Df ) x U ^^ y, where 3^ is a normed linear space, that satisfy 
fit, 0, 0, d) = 0, H{t, 0, 0) = for all {t, d) e i)t+ x Z) and the following hypothe- 
ses: 

(51) The mapping (x,u,d) -^ f(t,x,u,d) is continuous for each fixed f > 0, and 
there is a symmetric positive definite matrix P e i){"^" such that for every 
bounded / C i)i+ and every bounded S C C°([— r, 0]; !1t") x U, there exists a 
constant L > such that 

{x(0)-y(0))'p{f(t,x,u,d)- fit,y,u,d)) <L max |jc(r) - >'(t)|^ 

for all re/, (x, m, y, m) e 5 x 5, and d e D. 

(52) There exist functions y e /T"*" and a e Koo such that |/(f,x, m, fif)| < 
y{t)a{\\x\\r + \u\) for all (t,x,u,d) e !K+ x C°([-r,0]; Dt") x U x D, 
where \\x \\r denotes the sup-norm of the space C^([—r, 0]; di"), i.e., ||x ||r := 
maxge[-r,0] \x(0)\. 

(53) There exists a countable set A C i){''~, which is either finite or A = {tk; k — 
1, . . . , oo} with tk+\ > tk > for all ^ = 1, 2, . . . and limtk — +oo, such that 
the mapping (f , x, u, d) e (i)i+\A) x C^{[-r, 0]; !){") xUxD^ f(t, x, u, d) 
is continuous. Moreover, for each fixed (Jq, x,u,d) e !){"'" x C°([— r, 0]; fft") x 
U X D,we have limy^^+ /(/, x, u, d) — f(tQ, x, u, d). 

(54) The mapping H : 91+ x C^([—r, 0]; Dt") x [/ ^ 3^ is a continuous mapping 
that maps bounded sets of St"*" x C'^([—r, 0]; dl") x U into bounded sets of y. 

Remark 1.2 It is worth noting that Hypothesis (SI) is equivalent to the existence 
of a continuous function L : !){"'" x S)}"*" -^ Dt"*" such that for each fixed f > 0, the 
mappings L(t, ■) and L(-,t) are nondecreasing and satisfying the following inequal- 
ity: 

[xiO) - y(0))' P{f(t,x,u,d) - fit, y,u,d)) < L{t,\\x\\r + \\y\\r)\\x - y\\j 

for all (t, X, y, u, d) e S1{+ x C^({-r, 0]; m") x C°([-r, 0]; J)t") xU x D 

(1.8) 

Let Mu, Mo denote the sets of Lebesgue-measurable and locally essentially 
bounded functions u : D{+ -^ U and d : ilt"*" -^ D, respectively. By virtue of 
Hypotheses (Sl-3) above and Lemma 1 on p. 4 of [11], for every {d,u) e 
Mo X Mu, the composite map f{t,x, uit),d{t)) satisfies the Caratheodory con- 
dition on D{+ X C^{[—r, 0]; 9t"). Consequently, by virtue of Theorem 2.1 in [14] 
and its extension given in Paragraph 2.6 of the same book, for every (ro, xq, d, u) e 
Dt"*" X C^{[—r, 0]; 9t") x Mo x Mu, there exist h > Q and at least one continuous 
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function x : [to — r, Iq + h] ^^ di", which is absolutely continuous on [fo, ?o + h] 
with Tr(to)x — XQ and satisfies x(t) — f(t, Tr{t)x, u{t), d{t)) almost everywhere 
on [to,tQ + h]. 

Let X : [fo — r, t^ + h\^ !){" and y : [?o — r, t^ + h]^^ %\" be two continuous 
functions, absolutely continuous on [fo, fo + h] with 7]-(fo)x — xq, 7',(fo)3' = yo, 
and x(f) = f{t,Tr{t)x,u{t),d{t)), y(t) — f(t,Tr(t)y,u(t),d(t)) almost every- 
where on [fo, fo + h]. Evaluating the derivative of the absolutely continuous map 
z{t) — (x(f) — y(t)y P(x(t) — y(t)) on [fo, fo + h] in conjunction with Hypothe- 
sis (SI) above, we obtain the integral inequality: 



\x(t)-y(t)f<-^\x{to)-y(to)f + — / L||7;.(r)x - 7;(r)3;||^ Jt 
Vf e [fo, fo + h] 



where L := L(fo + h,a{to + h)), L(-) is the function involved in (1.8), a(t) :— 
s^Pzelto-rj] \xir)\+&up^elto-r,t] 1^(^)1 + sup^e[?o,t] |M(r)|, and ^i, ^2 > Oare con- 
stants that satisfy Ki |xp < x' Px < K2\x[^ for all x e iK". Consequently, we obtain 

||7;(0(x-}')||^<-^||xo-yoll? + — / L\\T,.{x){x - y)\ldx 
Vf e [to,to + h] 
An immediate application of the Gron wall-Bellman inequality gives: 

||r.(f)(x-y)||,.< /^||xo-yoll.exp(^-^(f-fo)j Vfe[fo,fo + /J] (1.9) 

Thus, we conclude that, under Hypotheses (Sl-3), for every (fo, xo, d, u) e S)t+ x 
C*'([— r, 0]; 9t") X Mo X Mu, there exist h > and exactly one continuous func- 
tion X : [fo — r, fo + /i] ^ Ot", which is absolutely continuous on [fo, fo + h] with 
Tr(to)x — Xo and x(f) — f(t, Tr(t)x, u(t), d(t)) almost everywhere on [fo, fo + h]. 
Using Hypothesis (S2) above and Theorem 3.2 in [14], we conclude that, for ev- 
ery (fo, xo, d, u) e 9t+ X C°{[-r, 0]; St") x Md x Mf/, there exists f^ax e (fo, +00] 
such that the unique solution of x(f) = /(f, 7',(f)x, u(t), d{t)) with T',-(fo)x — xo 
is defined on [fo — r, fmax) and cannot be further continued. Moreover, if f^ax < 
+00, then we must necessarily have limsup^^^- |x(f)| = +00, which implies 
limsup,^,- ||T'r(f)x||r = +00. 

Thus, for every (fo, xq, d, u) e !){+ x C^{[-r, 0]; St") x Md x Mu, the unique 
solution x(f) of x(f) = /(f, Tr{t)x, u(t), d(t)) with rr(fo)x = xo and the output 
trajectory F(f ) satisfy the following equations a.e.: 

jt(t) = /(f, 7;(f)x, M(f), d(t)) 
Y(t) = H{t,Tr(t)x,u{t)) 
x{t) e '}\",d(t) e D, Y{t) e y, u(t) e U (1.10) 

By allowing the output to take values in abstract normed linear spaces, we can con- 
sider general outputs. More precisely, we may consider the following cases: 
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• outputs with no delays, e.g., Y(t) — h(t, x(t)) with y — i)i*^, 

• outputs with discrete or distributed delay, e.g., Y{t) = h(x(t),x(t — r)) or Y{t) — 

//_^ hit, e,x{e)) de with y = 9t^ 

• functional outputs with memory, e.g., {Y(t)){6) — h{t, 6,x{t+6)) for 6 e [— r, 0] 
or the identity output Y{t) = Tr(t)x with y = C^{[-r, 0]; St*). 

We next provide an example of a biological system, similar to the one of Exam- 
ple 1.2.1, which takes the form (1.10) and satisfies Hypotheses (Sl^). Again, the 
example shows that it may be necessary to make certain manipulations in order to 
be able to satisfy Hypotheses (Sl^). 

Example 1.2.2 Consider the chemostat with one microbial species and one nutrient. 
In this case, it is assumed that the specific growth rate of the microbial species 
depends not only on the current value of the concentration of the nutrient s{t) but on 
its past values as well. We thus obtain the following chemostat model with delays: 

X{t)^{p{Tr{t)s)-D{t)-b)X{t) 
m = £>(0(^m - ^(0) - K{s{t))i^{s{t))X{t) 
X(t) e (0, +CX)), ^(0 e (0, sin), D(t) > (1.11) 

where (7;(f)i)(0) — s{t + 0) for e [-r, 0] is the r-history of s, /j > is the cell 
mortality rate, r > is the maximum delay, K{S) > is a possibly variable yield 
coefficient, and p : C^{[—r, 0]; (0, Sm)) -^ (0, +oo) is a continuous functional that 
satisfies 

min /x(i(r)) < p(Tr(t)s) < max ii(s{r)) (1-12) 

t—r<T<t \ / \ / t-r<T<t • ' 

The functions /Lt : [0, .Jin] — ^ [0, /^max], K : [0, iin] -^ (0, +oo) with /i(0) — 0, 
li(s) > for all s > are assumed to be locally Lipschitz functions. The chemostat 
model (1.11) under (1.12) is very general, since it covers the following cases: 

• p{Tr(t)s) — fi{s{t)), which gives a chemostat model similar to the chemostat 
model (1.4) with no delays, 

• p{Tr{t)s) — iJi{s(t — r)), which gives the time-delayed chemostat model studied 
in [45], 

• p{Tr{t)s) = X Y!l^Q Wiix(s(t - n)) + (1 - A) fl_^h(t+r- t)ix(s(r)) dx, where 
k e [0, 1], h e C°([0, r\, [0, +oo)) with /^ h{s)ds = 1, w; > 0, n e [0, r] (i = 
0, ...,«) with ^"^gw/ = 1. 

As remarked in [45], the chemostat model (1.11) under (1.12) allows the ex- 
pression of the effect of the time difference between consumption of nutrient and 
growth of the cells (see the discussion on pp. 238-240 in [45]). Since the mapping 
p : C^d—r, 0]; (0, si)) -^ (0, +oo) is rarely known, we will consider the uncertain 
chemostat model: 
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X(t) — ( min aisir)) +d(t)[ max ii(s(r)) — min ii(s(r))] 

\t-r<T<t ^ ' \t-r<T<t ^ ' t-r<T<t ^ '/ 

- D(t)-b\x{t) 

s(t) = £»(0(^in - ^(0) - K{sit))ix{s(t))X(t) 

X(t) e (0, +oo), s(t) e (0, ^in), D(t) > 0, d(t) e [0, 1] (1.13) 

where d{t) e [0, 1] is the uncertainty. 

System (1.13) is an uncertain system described by RFDEs. However, it does not 
satisfy all requirements described by Hypotheses (Sl-3). First of all, the set where 
the state variables take values is not the Banach space C*'([— r, 0]; J){^). In order to be 
able to recast system (1.13) to the form of system (1.10) which satisfies Hypotheses 
(Sl-3), we assume the existence of (X*,s*, D*) e (0, +oo) x (0,.s'in) x (0, +oo) 
such that 

/,M)= £)*+/; X*^ D*{sin-s*) 
^ ' ^(i*)(£>*+Z7) 

It should be noted that the change of coordinates: 

X^X exp(xi) 5 = 7r-^ r^ (1-15) 

G + exp(x2) 

where G := ^ — 1, and the input transformation 

D^D* exp(M) 
give the transformed control system: 

xiit) — min il(x2{r)) +d(t)( max fl(x2ir)) — min fl(x2(r))) 

t-r<T<t ^ ' \t-r<T<t ^ ' t-r<T<t ^ ' / 

- D* exp{uit)) - b 

i2(0 = £'*(Gexp(-X2(0) + l) 

X [exp(M(f)) - {G + sxp{x2{t)))g{x2(t)) exp{x[it))] 
ixux2) e 9i^ u{t) e 9t, dit) e [0, 1] (1.16) 

where 



-, . / Sinexp(X2) \ 

X* / .?inexp(X2) \ / ^inexp(X2) \ 

D*SinG \G+exp(x2)/ \G + exp(x2)J 



(1.17) 



Notice that by virtue of (1.14) and previous assumptions and definitions, sys- 
tem (1.16) satisfies Hypotheses (Sl-3) with Tr{t)x e C"([-r, 0]; df), u(t) eU ^ 
m, and dit) e D = [0, 1]. 

We finally define the output mapping Y(t) — Tr(t)x to be the identity mapping 
withy ^C°([-r,0];df). 
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Let (j): A^-^ C^{[—r, 0]; !H") be the mapping 0(r, Tq, xq, u, d) :— Tr(t)x, which 
for each (to,xo,d,u) e 9t+ x C°([-r, 0]; !)t") x Md x Mu and t e [ro, fmax) 
gives the "r-history" Tr{t)x e C^([—r,0]; fft") of the unique solution of i(f) — 
fit, Tr(t)x, u(t), d{t)) with Tr{to)x = xq. The mapping : A^ ^ C°([-r, 0]; Sit") 
is defined on the set A^ = U(ro,.vo,«,rf)e3i+xCO([-r,0];Sii")xM„xMo[fO' ^max) x 
{{t{),X{),u,d)}. It should be clear from all the above that the mapping <j) : A^ ^ 
C*'([— r, 0]; 9{") is well defined and satisfies the following properties: 

(1) Existence: For each (fo, xq, d, u) e 9t+ x C°([— r, 0]; 9{") x M^ x My, there 
exists f > f such that [fo, t] x {(fo, xq, m, cf)} C A^. 

(2) Identity Property: For each (fo, xo, cf, m) e 9{+ x C°([-r, 0]; ;){") x Md x Mu, 
it holds that (p(to, to, xq, u, d) — xo. 

(3) Causality: For each (t,to,xo,u,d) e A^ with f > fo and for each {ii,d) e 
M(7 X Mo with (ii(r),d(r)) — (u(r),d(r)) for all r e [fo, f], it holds that 
(f , fo, Xo, u, d) e A^ and 0(f , fo, xo, m, t/) — 4>{t, fo, xo, m, d). 

(4) r/ze ''Boundedness-Implies-Continuation" (BIC) Property: For each quadru- 
plet itQ,XQ,u,d) e !W+ X C°([-r, 0]; 9f') x My x Mq, there exists a max- 
imal existence time, i.e., there exists fmax £ (to, +oo] such that [fo, fmax) x 
{(fo, Xo, u, d)} c A0 and for all f > fmax, it holds that (f , fo, xq, m, d) ^ A^. In 
addition, if fmax < +oo then for every M > 0, there exists f e [fo, fmax) with 
||0(f,fo,xo,M,(i)||,- > M. 

(5) The Classical Semigroup Property: For each f G [fo, fmax), it holds that, for all 
T G [fo, f], (/)(f, T, </)(t, fo, Xo, M, c?), M, d) — (pit, fo, Xo, u, d). 



1.2.3 Control Systems Described by Coupled Retarded Functional 
Differential Equations (RFDEs) and Functional Difference 
Equations (FDEs) 

Let D C 9i' be a nonempty set, and U c Jti™ be a nonempty set with eU. Consider 
the system described by the following equations: 

il(f) = /l (f , d(t), Tr, (f)xi , T,.,-U,) (t - T(f))x2, u(t)) (1.18) 

X2(f) = /2(f, d{t), Tr, (f)xi, r,,_,(,)(f - T(f))x2, M(f)) (1.19) 

Y(t) = H{t, r,i(f)xi, r,2(f)x2, u(t)) G y (1.20) 

XI (f) G SK"' , X2(f) G 9t"2^ ^(f) G D, M(f) G {/, f > 

where ri, r2 > 0, // : Uf>oUl x -C* x C°([-ri, 0]; 9{"') x/:°°([-r2 + r(f), 0]; 9{"2) x 
t/ ^ W, i ^ 1,2, H : i)t+ X C°([-ri,0];9ri) x C°^([-r2,0];di"^) x U ^ 
y (with y being a normed linear space) are locally bounded mappings with 
fi(t, d, 0, 0, 0) = 0, f = 1,2, H(t, 0, 0, 0) = for all (f, rf) G !){+ x Z). The cou- 
pled system is depicted in Fig. 1.1. 

Specifically, we consider systems of the form (1.18), (1.19), (1.20) with initial 
conditions XI (fo + 0) =xw{0),6 G [-ri, 0], and X2(fo + 0) ^X2o(9),9 G [-^2,0], 
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described by coupled RFDEs 
and FDEs 









RFDEs 


Xi 




^ 




























FDEs 


















X2 







with jcio e C°([-ri, 0]; at"!) and X2o e C^H-ri, 0]; *H"2)^ under the following hy- 
potheses: 

(PI) The function r : SH"*" -^ (0, +oo) is continuous with supf>o tit) < rj- 
(P2) There exist functions a e K^o, fi e K~^ such that 

\fi{t, d, XI , Tr^-T(t) {-r(t))x2, u) I 

foTal\(t,d,xuX2,u)edi+ X Dx C°([-ri,0]; 9^') 
x/:~([-r2,0];9{"2) xU. 

(P3) For all jci e C°([-n, +oo); 3^"'), ^ e A?c(^^"^; -D), m e C^^i'in+; U), and 
X2 e /:~([-r2,+oo);9t"2), the mappings f ^ fi(t,d(t),Tr^(t)xi, 
Tr2-T(t)(t — t(t))x2, u(t)), i = 1, 2, are measurable. Moreover, for each fixed 
it,d,X2,u) e i)t+ X D X £^([-^2,0]; 9^2) x U, the mapping fi(t,d,xi, 
Tr2-T(t)(—t(t))x2, u) is continuous with respect to xi e C°([— ri, 0]; Ot"')- 

(P4) There exists a symmetric positive definite matrix P e 9ft"i><"i such that 
for every pair of bounded sets / C Bt"*" and Q. C C*'([— ri, 0]; Dt"') x 
C°°{[-r2, 0]; i)i"2) X [/, there exists L := L{I, Q.)>0 such that 



Blln 



(xi (0) - yi (0))'P(/1 (f , fif, XI , r,2-r(r) {-r{t))x2, u) 

- fi(t,d,yi, Tr2-T(t)(-T:(t))x2,u)) <L\\xi 

for all (t, d) e I X D, (xi, X2, u) e f2, and {yi,x2, u) e ^. (1.21) 

(P5) The mapping H : m+ x C°([-n,0]; St"') x £~([-r2,0]; DT^) x U ^ y 
is continuous with //(r, 0, 0, 0) = for all t >Q. Moreover, the image set 
HiQ.) is bounded for each bounded set ^ C 9t+ x C°([-ri, 0]; D^"') x 
C°°([-r2,0];?li"^)x U. 

For example. Hypotheses (PI), (P2), (P3) are satisfied if D C 9t' is compact 
and there exist continuous functions t,- : d\~^ -^ (0, +oo) (/ = 1, ...,/?), r : ?ll~^ -^ 
(0, +oo) with < Ti(f) < r2(f) < • ■ • < tpit) < r(t) for all f > and supj>o r(t) < 
r2, and continuous mappings gi : di+ xDx C°([-ri, 0]; fft"') x MP''^ x 9t'= x {/ ^ 
or- , / = 1, 2, /! : !)i+ X [-r2, 0] x M"^ -^ Dt*^ with g/ (t, d, 0, 0, 0, 0) = 0, /z(f , (9, 0) = 
for all it, 9, d) em+ x [-r -T,0]x D, such that, for each i = 1, 2, 



/; (t, d, XI , Tr2-T(t) (-r(t))x2, u) 
= g; I f , <i, XI, X2(-ri), X2(-r2), 



■ ,X2{-rp) 



r-T(t) > 

, / h{t,e,X2(6))de,u 

J-n I 
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fora\\(t,d,xuX2,u)em+ x Dx C°([-ri, 0]; ffi"') 

xC°^{[-r2,Q];m"'-) xU 

Systems of the form (1.18), (1.19), (1.20) arise in many problems in Mathematical 
Control Theory and Mathematical Systems Theory (see, for instance, [31, 35, 38, 
39] and the references therein). For example, consider the stabilization problem for 
the scalar system: 

jt(t) — f[x(t)) + u{t) + au{t — r) 

x(t)e'M,u{t)em (1.22) 

where / : JR ^- JR is a continuous function with /(O) = 0, and r > and a e i){ are 
constants. If the designer selects to apply the feedback linearization approach for 
system (1.22), then we have 

u{t) = -Kx{t) - f{x(t)) - auit - r) (1.23) 

where ^ > 0. Consequently, if a 7^ 0, the closed-loop system (1.22) with (1.23) is 
described by the following system of coupled RFDEs and FDEs: 

<c{t)^-Kx(t) 

u{t) — -Kx(t) - f{x(t)) - au(t - r) 

x{t)em,u{t)em (1.24) 

Notice that system (1.24) has the form of system (1.18), (1.19), (1.20) with u{t) in 
place of X2{t) and x(?) in place of x\{t). Moreover, Hypotheses (Pl^) are satisfied 
for system (1.24). 

However, the strongest motive for the study of systems of the form (1.18), (1.19), 
(1.20) is that systems of the form (1.18), (1.19), (1.20) allow the consideration 
of discontinuous solutions to systems described by Neutral Functional Differential 
Equations. For example, consider the scalar system described by a Neutral Func- 
tional Differential Equation 

— {x{t)-x{t-2r))^x{t-r) x(t) e^ (1.25) 

dt 

with initial condition T2r{tQ) = xq e C*'([-2r, 0]; W). The solution of (1.25) for t e 
[to,to + r] is given by 

x{t)^x(t -2r)+xito)-x(to-2r)+ xis)ds (1.26) 

JtQ-r 

It is clear from (1.26) that the solution of (1.25) can be defined even if the initial 
condition is discontinuous, i.e., 72,- (to) — xq e C°^([—2r, 0]; !)i). How to obtain such 
a (weak) solution? 

The following idea was proposed in [5] for linear systems (though it was ex- 
pressed in a different way). First, define 

xi(t) —x(t) -x(t -2r) 
X2(t)^x{t) 
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Then, (1.25) is transformed into the following system of coupled RFDEs and FDEs 
ofthe form (1.18), (1.19): 

xiit) ^ X2(t - r) 
X2(t) — xi (t) +X2(t - 2r) 
xi(f)eJ){,x2(Oe9{ (1.27) 

Notice that Hypotheses (Pl-4) are satisfied for system (1.27) (Hypothesis (P5) is 
irrelevant since there is no output). The solution of (1.27) for? e (fo, ^o + '"] is given 
by: 

nt-r 

xiit) — X]_(to) + X2(s)ds 

■'"'-' (1.28) 



X2(t) — X2it -2r) +xiito)+ / X2(s)ds 

Jto-r 



Notice that X2(t) = x (t) does not coincide with the solution of (1 .25) given by (1.26) 
unless xi(to) — X2(fo) — X2(to — 2r), the so-called "matching condition." It should 
be emphasized that, if the "matching condition" does not hold, then the solution 
of (1.27), given by (1.28), is discontinuous, even if the initial condition is smooth. 
Consequently, system (1.27) provides a generalized framework for the study of the 
Neutral Functional Differential Equation (1.25). The idea described for the sim- 
ple example (1.25) can be generalized for nonlinear control systems described by 
Neutral Functional Differential Equations of the following form (special case of the 
so-called Hale's form, see [14]): 

-{xit) - g{t, Tr-r(r){t - r(f))x)) = f{t, d{t), TAt)x, u{t)) x(0 e m" (1.29) 

Without loss of generality, we may assume that the continuous function r : flt"*" — >• 
(0, -|-oo) with sup,>or(?) < r is nonincreasing. If we define xi{t) — x{t) — 
g(t, Tr-z(t)(t — x(t))x), X2{t) —x{t), and the operator 

D{+ X C°{[-r, 0]; !)f ) x C°°{[-2r, 0]; flf ) 3 (t, xi, X2) 
-^ G(r,xi, T2r-T(t){-T:(t))x2) 

G{t,Xi, T2r-r(t){-T:{t))x2) 

^^\x2i9) 9e[-r,-r(t)] 

■~ [ xi(0) + g(t + 9, Tr-r(r+e)(0 - r(t + 9))x2) 9 e (-r(f), 0) 

then system (1.29) is associated with the following system described by coupled 
RFDEs and FDEs: 

Xl(t) = f{t, d{t), Git, Tr(t)xi, T2r-T{t){t - r(t))x2), u(t)) 

(1.30) 

X2(0 = XI (f) + g{t, Tr-r(t)(t - r(f))X2) 

Notice that system (1.30) is in the form of (1.18), (1.19). The component X2 
of the solution of (1.30) coincides with the solution x of (1.29) if and only if 
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the initial data are continuous functions which satisfy the "matching condition" 
G(fQ, Tr(to)xi, T2r-T(tQ)(tQ — t(ro))x2) — Tr{to)x2. However, notice that even if the 
matching condition holds, the solution of (1 .30) can be defined for discontinuous ini- 
tial data. Consequently, if the matching condition holds and the initial data are dis- 
continuous, then the component X2 of the solution of (1 .30) is a discontinuous map- 
ping which satisfies the differential equation jj:(X2(t) — g(t, Tr-z(t)(t — r{t))X2)) — 
f(t, d(t), T,.{t)x2, u(t)) almost everywhere for t > Iq. Thus, if the matching condi- 
tion holds, then system (1.30) provides "weak" solutions to the Neutral Functional 
Differential Equation (1.29). 

The approach described above is not restricted to Neutral Functional Differential 
Equations of the form (1.29). We can also consider Neutral Functional Differential 
Equations of the form (Bellman's form, see [3]) 

i(t)^f{t,d{t),Tr(t)x,Tr-r(,){t-r(t))i,u(t)) x(t)edi" (1.31) 

In this case, the corresponding system of coupled RFDEs and FDEs is 

ii(0 = f{t, d{t), Trit)xu 7;._^(,)(f - r(t))x2, u(t)) 

Xlit) = f{t, d(t), Tr(t)xi, Tr-r(,){t - r(t))x2, u(t)) 

xi(t) e m'\x2(t) e m",dit) e D, u(t) eU,t>0 (1.32) 

Notice that, if Tr(tQ)x2 = Tr(tQ)x and Tf{tQ)xi — Tr{tQ)x, then the component xi of 
the solution of (1.32) coincides with the solution x of (1.31) for all t > Iq. 

Consequently, it should be emphasized that the study of coupled RFDEs and 
FDEs offers a great advantage: Neutral Functional Differential Equations of the 
form (1.29) and Neutral Functional Differential Equations of the form (1.31) can be 
studied in the same way and in the same framework. 

Another field which motivates the study of systems of the form (1.18), (1.19), 
(1.20) is the field of control (or dynamical) systems described by hyperbolic partial 
differential equations of the form 

--(f, z) -f- fl/ ^-(?, z) = /;■ f , vi{t, z), 1(0) / = 1, . . . , /9 

Ot dz 

Vi{t, z) e at"' , ^(r) e ^t^ z e [0, 1] (1.33) 

where a, > (i — I, . . . , p) are constants, along with boundary conditions of the 
form 

Vi(t, 0) = Fi{t, d(t), 1(0, u(t), v(t, z); z e [r(0, l]) / = 1, . . . , p (1.34) 

where vit,z) — (vi(t, z), ■ ■ ■ , Vp{t,z))' and 

1(0 = g{t, d{t), Hit), u{t), v{t, z); z e [r (0, l]) (1.35) 

The system of equations (1.33), (1.34), (1.35) is accompanied with initial conditions 
vi (to, z) = i;o/ (z) and ^(fo) = ?o e i)t*. 

If we define xi(0 = ?(0 and X2(0 = ivi(t, 0), . . . , Vp(t, 0))', then it can be 
shown that the state variables xi(0, X2(t) satisfy a system of coupled RFDEs and 
FDEs for any f > ?o + max,=i_ ^a^ . Consequently, the asymptotic behavior of 



dt 


z) + 


dv 


(t,z) 




z) + 


dh 
Jz 


(t,z) 
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system (1.33), (1.34), (1.35) is determined by the associated system of coupled 
RFDEs and FDEs. The discontinuous solutions generated by the associated sys- 
tem of coupled RFDEs and FDEs are important, since such solutions correspond to 
"weak" solutions of the problem (1.33), (1.34), (1.35). 

We next provide an example of a physical system, which is described by partial 
differential equations and can be represented by equations (1.18), (1.19). 

Example 1.2.3 (The linearized St. Venant equations) We consider the following sys- 
tem of partial differential equations: 

(1.36) 

: -U(t) 

where z e [0, 1] and u(t) e di. The above system of partial differential equations is 
the linearization of the nonlinear system of partial differential equations describing 
the height h(t, z) and the horizontal velocity v(t,z) of an inviscid incompressible 
fluid contained in a tank at time f > and position within the tank z e [0, 1]. The 
tank is constrained to move only in the horizontal direction, and the position and the 
velocity of the tank are denoted by D(t) and s(t), respectively. Since u{t) e 9i is 
the horizontal acceleration of the tank (i.e., the force acting on the tank), we have in 
addition the following ordinary differential equations: 

D(t)=sit) i(0 = M(r) (1.37) 

Finally, the system is accompanied by the "no-flow" boundary conditions 

i;(r,0) = i;(f, 1) = (1.38) 

The reader should notice that the controllability and stabilizability problem of 
system (1.36), (1.37) has attracted attention (see [8], p. 212, and [41]), since 
it is known that system (1.36), (1.37) is uncontrollable (see [40]). By defin- 
ing A(t,z) ■.^h(t,z) + v(t,z), B(t,z) ■.^h(t,z) - v{t,z), X2,i(t) := A(f,0), and 
-^2,2(0 '■— B(t, 1), we obtain by direct integration on the characteristic lines: 



A(f,z) = 



B{t,z)- 



ho(z-t) + VQiz-t) - f^u(r)dr for r < z 

X2,i(t - z) - fl_^uit)dr forf>z 

hoiz + t) - voiz + t) + Jq u{x)dx for r < 1 - z 

xi.iit + z - 1) + //+,_! u{r)dr for r > 1 - z 



where /jo(z) := h{0,z) and i;o(z) := v(0,z). By defining X2,i(— w) :— ho(w) + 
vo{w) and X2,2(— w) :— ho(l — w) — iio(l — w) for w e [0, 1] and using the re- 
lations h(t,z) — j(A(t,z) + B{t,z)) and v{t,z) — \(A{t,z) - B(t,z)), we obtain 
for all t > 0: 
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J J I rmax(0,t-z) 

hit,z)^-X2,i(t-z) + -X2,2it + z-l) + - u{r)dr (1.39) 

II I ^max(0,f+z-l) 

1 1 1 /" 

v{t,z) — -X2^\{t-z)--X2^2(t + z-\)-- \ u{x)dx 



2 ' 2 ' 2, 



max(0,/+z-l) 



-- j u(r)dr (1.40) 

It should be noticed that the above equations give discontinuous solutions for sys- 
tem (1.36), (1.37) if the initial conditions /jo(z) := h(0, z) and vq{z) := i>(0, z) are 
discontinuous functions. Finally, we exploit the boundary conditions (1.38). Us- 
ing (1.38) and (1.40), we obtain for all t > 0: 

X2,i(t) = X2,2(t - I) + u{x)dx 

Jma\(0,t-l) 
•^2,2(0 =-«2,l(? - 1) - / u{x)dx 

Consequently, we are led to the study of the following linear autonomous control 
system of coupled RFDEs and FDEs: 

ii,i(0 =-^1,2(0 

ii,2(0 =m(0 

X2,\{t) =X2,2(f - 1) + XI, 2(0 -Xi^2(t - 1) 
X2,2{t) =X2,l(f - 1) -X\^2{t)+X\^2{t - 1) 

xl(f) = (xl,l(0,xl,2(f))eSH^X2(0 = (x2,l(0,■«2,2(0)eai^M(0e9^ (1-41) 

where xi.i(r) is the position of the tank D{t), and x\2(t) is the horizontal veloc- 
ity of the tank s{t). Notice that system (1.41) gives weak solutions for the orig- 
inal system (1.36) if X2,\{—w) :— h(0, w) + v{0, w), X2,2(— w) :— h{0, I — w) — 
v{0, 1 — w), and xi_2(— w) = xi,2(0) for w e [0, 1] by means of the formulae 

11 11 

h(t,z)^-X2,l(t-z) + -X2,2it + Z- I) + -Xl,2(t - Z) - -Xl,2{t + Z- 1) 

1 1 1 

V{t,z) = -X2,l(t -Z)- -X2,2{t + Z- I) - Xi^2{t) + -Xia'^t + Z - 1) 

1 

+ -Xl,2{t-Z) 

Questions of controllability and stabilizability for system (1.36), (1.37) can be ad- 
dressed by studying system (1.41). 

The following theorem is the major tool for the existence of solutions of the 
system of coupled RFDEs and FDEs of the form (1.18), (1.19), (1.20). 

Theorem 1.1 Consider system (1.18), (1.19) under Hypotheses (Pl-4). Then, for 
every to > 0, (xio, X2o) e C°([-n, 0]; M"') x C°^([-r2, 0]; di"^), d e C^{^\+- D), 
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u e £j^^ ($){"*"; [/), there exist fmax £ (^O; +00] and a unique pair of mappings 

XI e cO([fo - n , fniax); 5«"'), X2 e /:~ ([fo - ^2, wJ; at"^) w/f/i r,, (ro)xi = xw, 
Tr2ito)x2 = ^20, XI e C ([to — /"i, fmax)! fff"') being absolutely continuous on 
[to, fmax) such that (1.18) holds a.e. for t e [fo, fmax) cind (1.19) holds for all t G 
(fo, ?max)- ^« addition, ift^ax < +00, then for every M > 0, there exists t e [fo, ?max) 
w(f/i ||7>i(r)xi||,-, > M. 

Theorem 1.1 guarantees that r^ax £ (fo> +00] is the maximal existence time for 
the solution of (1.18), (1.19). The idea behind the proof of Theorem 1.1 is the 
method of steps, used already in [35]. 

Proof of Theorem 1.1 Let to > 0, (xio,X2o) e C"([-ri, 0]; Dt"') x C°°([-r2,0]; 
*H"2), d e C^^(^i+; D), and u e -Cj^ (ifl+; U) (arbitrary). 

Define h :— min(l; min{r(ro + i') : s e [0, 1]}). Notice that by virtue of the def- 
inition of ft > 0, it holds that t — tit) < to for all t e [fo, ?o + h}. By virtue of 
Theorem 2.1 in [14] (and its extension for Caratheodory conditions in p. 58 of 
the same book), there exists 8 e (0, h] and xi e C^{[to - ri,to + 5); iU"') with 
Tr^ {to)x\ — x\o being absolutely continuous on [to, to + 8) such that the differ- 
ential equation xi(f) — f[(t,d(t), Tr^(t)xi, Ti-2-T(t)(t — T(r))x2, m(0) is satisfied 
a.e. for t e [to,to + S). Moreover, Hypothesis (P4) guarantees that the mapping 
xi e C^{[to — r[,to + S); 9t"') is unique. Without loss of generality, we may as- 
sume that S is the maximal time of existence of the solution of differential equa- 
tion (1.18) in the interval (0,h]. There exist two cases for the mapping xi e 

c°{[to-ri,to + sy,di"'y. 

(a) For every M > 0, there exists t e [to, to + S) with \\T,.^ (t)xi H^ > M. 

(b) IITVj (/)xi llri is bounded for all t e [to, to + h). In this case, the mapping xi e 
C^i[to — r\,to + ^); 9t"') can be extended continuously in a unique way on 
[to-ri,to + h]. 

Next, we consider the FDEx2(0 = f2(t,d(t), 7)-, (f)xi, Tr2-T{t){t — 'c{t))x2, u(t)). 
By (P2) and(P3), there exists a unique mapping X2 e C^^([to — r2, ^0 + ^); 9^"^) with 

Tr2(to)X2 = X20 such that X2(0 = f2(t,dit),Trj(t)xi,Tr2-T(t){t - r{t))x2,u(t)) 

holds for all f e (fo, ?o + 5)- Moreover, if the mapping xi e C'^([to- ri,to + S); iW"') 
can be extended continuously in a unique way on [fo — ri,to + h], then, similarly, 
X2 e C°^([to — r2, to + 5); i)i"-) can be extended on [fo — '"2, ^o + h] (notice that 
Hypothesis (P2) implies that X2 is bounded as long as xi is bounded). 

If case (a) holds, the proof is completed by defining r^ax — tQ + ^- If case (b) 
holds, all arguments can be repeated with fo + ^ in place of fo (next step). We con- 
tinue the same procedure of construction of the solution step-by-step. The procedure 
may be stopped after some steps (if case (a) is encountered) or may be continued 
indefinitely (if case (a) is never encountered). In the latter case, for each step ( , we 
obtain a pair of mappings XI e C°([fo-ri, f,+i]; !){"i),x2 e C°^([to-r2, f,+i]; ?i\"-) 
with r,-, (fo)xi =xio, Tr2{to)x2 =X2o, xi e C^{[to — r\, f,+i]; 9t"') being absolutely 
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continuous on [fo, fj+i] such that (1.18) holds a.e. for t e [Jq, f,+i] and (1.19) holds 
for all t e (to, r,+i], where the sequence {ti}f^Q satisfies 

f,_,_i = ti + min(l ; min{ r (r,- + .s) : .? e [0, 1] }) for all /= 0, 1 , 2, 

Notice that the sequence {f/l^o ^^ increasing and consequently limf, — supf;. 
The assumption that L — limf,- — supf; < +oo implies that f,-|_i > t, + /x for all 
( = 0, 1, 2, . . . , where // — min(l; min{r(i') : s e[0, L + 1]}), which gives the con- 
tradiction ti > fo + (i — 1)m for all ( = 1 , 2, It follows that lim f,- — sup f, = +oo. 

The proof is thus completed. D 

Let Mf/ and Md denote the sets of Lebesgue-measurable and locally es- 
sentially bounded functions u : S)t+ -^ U and d : St^ -> D, respectively. Let 
: A^ ^ C''([-ri,0];i)r>) x C°^([-r2,0];d\"2) be the map (p{t,tQ,XQ,u,d) = 
{Tr^(t)xl,Tr^{t)x2), which for each (fo, xq, c?, m) e S1{+ x C''([-ri,0]; !1t"') x 
/:~([-r2,0];9r2) X Md X Mu and f e [fo, fmax) gives the "history" of the 
unique solution of (1.18), (1.19) with T'r(fo)x — xq. The mapping cf) : A^j, ^>- 
C°([-ri, 0]; 9{"i) x £~([-r2, 0]; *)f' 2) is defined on the set 

^0= U [?0,fmax){(?0,-«0.«-G?)} 

(ro,.vo,u.d)e3i+xCO([-n.O];;i!"l)x£^([-r2,0];i1!"2)xM(;xMD 

It should be clear from all the above that the mapping : A^ ^ C" ([— ri , 0] ; !){" ' ) x 
£oo([_^2, 0]; !){"2) is well defined and satisfies the following properties: 

(1) Existence: For each (fo,xo,^, m) e D{+ x C°([-n, 0]; !){"') x /:~([-/-2,0]; 
9t"2) x Md X Mil, there exists f > fo such that [fo, f] x {(fo, xo, u, d)} c A^. 

(2) MenffY); Property: For each (fo,xo,c/,M) e *){+ x €"([-^1, 0]; iJt"') x 
£~([-r2, 0]; 9^2) x Mo x Mu, it holds that 0(fo, fo, xo, u,d)= xq. 

(3) Causality: For each (t,to,XQ,u,d) e A^ with f > fo and for each (m,J) e 
My X Mo with {u(t),d(t)) — (u{r),d(r)) for all r e [fo, f], it holds that 
(f , fo, Xo, M, fi?) e A^ and (p{t, to, xo, m, t/) — (pit, to, xo, u, d). 

(4) The "Boundedness-Implies-Continuation" (BIC) Property: For each (fo,xo, 
d, u)em+ X C°([-ri, 0]; 91"') x /:~([-r2, 0]; Dt"^) x Mq x Mj/, there exists 
a maximal existence time, i.e., there exists fmax e ('o, +00] such that [fo, fmax) x 
{(fo, Xo, M, d)} C A0 and for all f > fmax, it holds that (f , fo, xq, u, d) ^ A,^. In 
addition, if fmax < +00, then for every M > 0, there exists f e [fo, fmax) with 
yr^-j (f)xi lln > M, where <p(t, fo, xo, m, d) :— (T^ (f)xi, Tr2(t)x2)- 

(5) 77ze Classical Semigroup Property: For each f e [fo, fmax), it holds that 
(f>{t, r, (/)(r, fo, Xo, M, d), u, d) — 4>{t, to, xo, u, d) for all r e [fo, f]. 

Again, the reason for allowing the output to take values in an abstract normed 
linear space is that the case (1.18), (1.19), (1.20) allows the study of: 

• outputs with no delays, e.g., Y{t) — h{t, xi(f), X2(f)) with y — 9{*, 

• outputs with discrete or distributed delay, e.g., Y{t) — h(x{t),x{t — r)) or Y{t) — 
fl_^ h(t,9,xiie))dev/ithy^m''. 
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• functional outputs with memory, e.g., {Y(t)){6) — h{t,6,x\{t + 6)) for 6 e 
[— ri , 0] or the identity output 

\x2(t + e) 0e[-r2,O] 



with 



3; = C°([-n,0];9f{"i) x/:~([-r2,0];9t"2). 



1.2.4 Control Systems Described by Functional Difference 
Equations (FDEs) 

Consider the class of systems described by the following FDEs: 

x(t) = f{t, d(t), Tr-r(,){t - r(t))x, u{t)) 
Y{t)^H{t,Tr{t)x,u{t)) 
x{t) e ?ii",d(t) e D, u(t) eU,t>0 (1.42) 

where D C JR' is a nonempty set, U c !1t"' is a nonempty set with e U , r > 0, f : 
Uf>o{^f X D X B(t) X U ^ !){", and B{t) denotes the set of all bounded mappings 
X : [—r + r(f), 0] ^^ i)t" under the following hypotheses: 

(Ql) The function r : S){+ ^ (0, +oo) is continuous with sup,>o ''^(0 ^ '"• 

(Q2) There exist functions a e ^oo, y6 e K^ such that \f{t,d, Tr-z{t)(—T:{t))x, u)\ 

< a(j6(f)||r,._T(f)(-r(f))x||r-T(o) + a(P{t)\u\) for all (t,d,x,u) e D{+ x 

D X X X U, where X is the normed linear space of bounded functions 

X : [— r, 0] -^ !){" with norm \\x\\x — sup_^<j.<Q |x(r)|. 
(Q3) The mapping H : D'i"'" x X x U —i^ y, where 3^ is a normed linear space, is 

continuous with H{t, 0,0) =0 for all r > 0. Moreover, the image set H{Q.) is 

bounded for each bounded set ^ C 9i+ x X x U. 

Using the method of steps, exactly as in the proof of Theorem 1 . 1 , we can obtain 
the following result. 

Proposition 1.1 Let Mu and Md denote the sets of locally bounded functions 
u : i)}"*" -^ U and d : St"*" — >• D, respectively, and consider system (1.42) under Hy- 
potheses (Ql), (Q2). Then, for all to > 0, xq e X, and (m, d) e Mj/ x Mo, there 
exists a unique locally bounded mapping x : [fo — r, +oo) — > 9{" with Tr(to)x — xq 
such that (1.42) holds for all t > tQ. 

Systems of the form (1.42) are important and arise in many situations. We next 
provide an example, which shows that systems of the form (1.42) can be used for 
the study of time behavior of dynamic games. 
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Example 1.2.4 (The dynamic Cournot oligopoly) We consider the case of Cournot 
oligopoly where n players produce quantities of a single homogeneous product. The 
payoff function for each player is expressed by 

1 



^i ^Pqi -Ciqi 



:Kiqt i^l. 



(1.43) 



where Ki, ci, i — \, . . . ,n, are constants, qi e [0, 2,], / = 1, . . . , n, is the quantity 
of the commodity produced by the ith player, (2, > is the maximum level of 
production of the product for the / th player, and p > is the price of the commodity. 
Assuming a Unear demand function 



P^bia-Y^c 



(1.44) 



1=1 



where a,b > Q are constants satisfying a > ^f-j Qi and b > — jmin,=i .. _„ Ki 
we obtain the best reply mapping for each one of the players: 



qi ^ fiiq-i) := 
i — \, . . . ,n 



Qi , max 



0, 



ah ■ 



2b + Ki 2b + Ki 



z4 



We define 



5:=[o,ei]x[o, e2]x--x[o,e„]c9r 

q ^ {qi, ...,qn) e S 



F{q): 



Mq-i)' 



fniq-n) 



mini gi, maxiO, 



ab—C{ 

2b+K[ ' 2b+K 



+Ki T,j^l^j}} 



min{ e„, max{0, ^-^ ^ .^„ qj } } _ 



(1.45) 

(1.46) 
(1.47) 

(1.48) 



and we notice that the set S C M" as defined by (1.46) is compact and convex and 
that the map F : S ^^ S as defined by (1.48) is continuous. Consequently, Brouwer's 
fixed point theorem guarantees the existence of at least one Nash equilibrium q* e S 



V^ith q*^fi(q*_.): 



:min{e,-,max{0, ^^ 



25T^E./^,-9*}}for( = l,. 



Next, we assume that the dynamics of the game are described in continuous time 
as follows: 

• every player forms an expectation for the behavior of all other players at each 
time r > 0: the expectation of the ith player for the production level of the jth 
player at time / > will be denoted by q'^'J'it) e [0, Q j] (J ^i,i, j — I, . . . , n), 

• every player determines her production level as a convex combination of a past 
production level and the best reply response based on the expectations for the 
behavior of all other players at each time ? > 0, i.e., for each i — 1,2, ... ,n, 



qi (t) = Bi (r) min{ Qi , max{0, qi {t - n (f )) } } + (l - e,- (t)) 

ab — c: b 



X mm 



Qi , max 



0, 



2b + Ki 2b + K, 



-gO'-jj 



(1.49) 
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where 0, : St"*" -^ [0, 0] and r, : Dt"*" ^ [T, r] are in general unknown functions, 
and < < 1 and < T < r are constants (in general unknown). 

The reader should notice that (1.49) is a model that evolves in continuous time, i.e., 
t e !){"'". If the expectation rules q^^f{t) (j ^ i, i, j — I, . . . ,n) and the functions 
9i : !){"*" —^ [0, 0], T; : Dt"*" —^[T,r](i — l,..., n) were known, we would have an 
accurate description of the dynamics of the Cournot oligopoly game. However, we 
will not assume exact knowledge of the expectation rules but a specific consistency 
condition. More specifically, we will assume thatYYYYYYYYY: 

(H) All expectation rules qfj{t) (j ^i, i, j — I, . . . ,n) are Consistent Backward- 
looking expectations with respect to the Nash equilibrium point q* e S, i.e., 
there exist constants < T <r such that, the following inequalities hold for all 
j ^i,i, j — \, . . . ,n and for all f > 0: 

\qTf it) - q*j\ < sup \qj{r)-q*\^\qj-q*\ (1.50) 

'■' t-r<T<t-T ■ ' ^ ' ^ 

In other words, the consistency condition (1.50) recognizes that it is not logical for 
the (th player to expect that the production level of the 7 th manufacturer will deviate 
from its equilibrium level more than the highest deviation she has experienced in the 
past. Next, we present some examples of Consistent Backward-looking expectation 
rules: 

(1) q-'^J{t)^aij{t)Y!J'=i w/,;,/(0?y(f-r/,/,,(r)) + (l-a,j(0)?;, where a,,,(0 e 
[O', 1], r > njjit) >T>0, Wijj(t) > with 1 = EiLi^iJjit) for all 
f > and / = \,...,m. In discrete-time models the case tijjit) = t + 
I — [t], aij(t) = 1, Wjjiit) = Wi^jj > with 1 — ^"Ij Wi,j,i is the usual 
backward-looking expectation, which gives qf^fit) — Y^J^i wijjqjik — I) for 
te[k,k+l). 

(2) q^Jit) = at J (?) /r/ hi J is)qj (t + s)ds + (l- at^j (t))q*, where 0<T <r, 
<^i, i (0 £ [0, 1] for all f > 0, /z,_ / : [— r, —T]^ ))\ is a Lebesgue-integrable func- 

r—T 

tion with hij{s) > for almost all s e [— r, —T] and 1 = j_^ hij{s)ds. Of 
course, in this case it is additionally required that g/(f) must be Lebesgue inte- 
grable and essentially bounded. 

We notice the following important fact for consistent backward-looking expecta- 
tions: 

Fact g- j(t) (where j ^ /, (',_/ = 1, ... , n) is a Consistent Backward-looking ex- 
pectation with respect to the Nash equilibrium point q* e S if and only if there exist 
constants < T < r and a function dij : M'^ -^ [—1, 1] such that 

q.J(t) ^min{Qj,miix{0,q* + di^jit)\\qj - q*\\^^_^^_j.^}} 
forallt>0 (1.51) 

Proof of Fact Assume first that q'^'^fit) (where j ^i,i, j — 1, . . . , n) is a Consistent 
Backward-looking expectation with respect to the Nash equilibrium point q* e S, 
i.e., that (1.50) holds. We distinguish the following cases. 
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Case 1: \iq^^?{t) = 0, then (1.50) implies that g'* < \\qj — g"?!! [,_;., -j-j. In this case 

we define dij(t) = — 1, and equality (1.51) holds. 
Case 2: If q- Jit) = Qj, then (1.50) implies that Qj - q* < Wqj - q*\\i,-r,t-T]- In 

this case we define dij{t) = 1, and equality (1.51) holds. 
Case 3: l{q'^'^^(t) e (0, Q j) and \\qj — q*\\[,-r,t-T] > 0, then equality (1.51) holds 

with dijit) = sgn{qfj(t) - ^Pj^jii^^;^:^^- Inequality (1.50) implies that 

Kj(OI<^ 

Case4: lfq^^^(t) e (0, Qj) and \\qj - q*\\[,-rj-T] = 0, then inequality (1.50) im- 
plies that qfj{t) — q*. In this case equality (1.51) holds for arbitrary dij{t) e 
[-hi]. 

On the other hand, if(1.51)holds,then^fJ(f) e [0, Q j] for all f > 0. Moreover, 
the reader can verify that inequality (1 .50) holds. The proof is complete. D 

The previous fact shows that Hypothesis (H) is equivalent to the existence of 
constants < T < r and functions d, j : iW"'" ^-[—1,1] (j y^ i,i, j — I, . . . ,n) such 
that the following equalities hold for all / = 1, . . . , m: 

qi (t) = 0i (t) min{ g,- , max{0, qi {t - r,- (r)) } } 

ab — Ci 



(l-0,(f))min 



Qi, max 



0, 



2b + Ki 



2b + K, 



J2 min{ Qj , max{0, q* + dij (t) \\ qj - q* \\ [,_,_,_r] } } j j 



(1-52) 



In general, the functions 0; : S1{+ -^ [0, 0], Xi : D{+ -^ [T, r], dij : D{+ -^ [-1, 1] 
(j ^ /, i, j — 1, . . . , n) and the constants O<0<1, 0<r<r are unknown. 
Therefore, the dynamical system (1.52) is an uncertain dynamical system de- 
scribed by Functional Difference Equations (FDEs). In order to recast (1.52) to the 
form (1.42) under Hypotheses (Ql), (Q2), we define the dimensionless deviation 

variables x/(f) = -^^ — '- (i — I, . . . , n), and we obtain from (1.45) and (1.52) for 
i — I, . . . ,n: 

Xi{t) —6i{t)nnn{l — Li, max{— L/,x/(r — r,(f))}} 

-I- (l — 6i (t)) min I — Lj, max -Lj , M/ — L/ 

-7?;^g,.jmin{l,max{0,Lj+J,,,(OI|x/||[,-,,,-r]}} (1.53) 

where L,- = | e [0, 1], M,- = j^^^, R, ^ ^ > 0, g,-,, = f > 
for j ^ i, i — l,...,n, are constants which satisfy L, — minjl, max{0, M, — 
Ri '^Zj^i gi.jL j}} for all / = 1, . . . , n. The reader should notice that Hypotheses 
(Ql), (Q2) hold for system (1.53) with x{t) = T. 
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Finally, notice that 
• All discrete-time models of the form (/ 

qi(k+l)^9i(k)qiik) + {l-eiik)) 



.,«) 



X mini Qi, max 



0, 



ab 



2b + Ki 2b + 






with 



q-'fik + 1) = aijik) J2 WijAk)qj{k - /) + (l - aijik))q* (1.55) 

where k, m are nonnegative integers, aijik) e [0, 1] (/, y = 1, . . . , n), 9i(k) e 
[0, 0] 0' = 1, ... , «) with e [0, 1), w'ijjik) > with 1 = ^jlg w,j,/(fc) for 
all A; > and I — 0, . . . ,m (i, j = 1, . . .,n), are immersed in the uncertain model 
(1.52) and its equivalent expression (1.53) in the sense that for every model of the 
form (1.54), (1.55) one can give functions 0,- : 9i+ -^ [0, 0], Xj : M+ -^ [T, r], 
dij : di~^ -^ [—1, 1] (7 ^ /, i, j — 1, . . . , n) such that the solution of (1.52) coin- 
cides with the solution obtained by the discrete-time model (1.54), (1.55). 
• All continuous-time models of the form 

0, ^^ - :,7^l^q]:^it) \ \ - f^^q^it) 

(1.56) 

where, for each / = 1, . . . , n, /li,- > are constants, and q^^f{t) (j / /, j — 
I, . . . ,n) are Consistent Backward-looking expectations with respect to the Nash 
equilibrium point q* e S, are immersed in the uncertain model (1.52). Indeed, 
for all ! = 1, 2, . . . , n and t > r > 0, the solution of (1.56) implies the following 
integral equations: 



qi (?) — fxi min] Q, , max 



(g/j 



^EC'wJI 



g,(0=exp(-/x/r)g,(r 
X i Qi, max 



0, 



-r) + 
ab — 



/ exp{-/Xi(t -r)) 

Jt-r 



2b + Ki 2b + Ki 






From the above expression under the assumption that the mappings t 
(j y^ i, i, j — I, . . . ,n) are continuous, we can conclude that for all f > r and / 
!,...,«, there exist gi{t) e[t — r,t], i — I, . . . , n, such that 

qi(t) = exp(-fiir)qi(t - r) + (l - exp(-/x,/-)) 

ab — Ci I 



Jit) 



X min 



Qi, max 



0, 



2b + Ki 2b + Ki 






The reader may verify that for Consistent Backward-looking expectations with re- 
spect to the Nash equilibrium point q* e S, the above model can be described by 
the uncertain model (1.52) with 0,(f) = exp(— /i,r), T,(f) = r, i — 1, . .. ,n, and 
:=max/=i,...,„exp(-/x,r) < 1. 
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We define the output mapping to be the identity mapping H(t,x,u) :— x for all 
X e X. This example will be studied further in Chap. 5. 

Let X be the normed linear space of bounded functions x : [—r, 0] -^ ^i" with 
norm ||x||;f — sup_,.<j.<o kC''')!; </> : A^ — > A" be the mapping (j)(t,tQ,XQ,u,d) :— 
Tr{t)x, which for each (tf),xf),d,u) e !1i+ x A" x Mo x Mu and t e [fo,+oo) 
gives the "history" of the unique solution of (1.42) with Tr(t{))x — xq. The map- 
ping : A0 ^ A" is defined on the set A^ = U(ro,Ao,«,rf)e9i+xA-xMt, xMo [?o, +oo) x 
{(?Q, xq, M, cf)}. It should be clear from all the above that the mapping (p : A^ ^^ X 
is well defined and satisfies the following properties: 

(1) Existence: For each (to,XQ,d, u) e 9i+ x ^ x Md x Mu , there exists r > ?o 
such that [fo, ?] x {(fo, xq, u, d)} c A^. 

(2) Identity Property: For each (fo, xq, cf, u) e di~^ x X x Mu x Mu , it holds that 
(l){to,tQ,xo,u,d)=X{). 

(3) Causality: For each (t,tQ,XQ,u,d) e A^ with t > to and for each (M,(jf) G 
M(7 X Mo with (M(T),J(r)) — (u{r),d(r)) for all r e [fo, ?], it holds that 
(f, fo, xo, M, (i) e A^ and (/)(f, fo, xo, u, d) — (p(t, fo, xo, m, (i). 

(4) The '"Boundedness-Implies-Continuation" (BIC) Property: For each (fo,xo, 
d, u) e 9^+ X X X Md x Mj/, there exists a maximal existence time, i.e., there 
exists fmax ^ (fo, +oo], such that [fo, fmax) X {(fo, Xo, M, (i)} C A0 and for all t > 
fmax, it holds that (t,to,xo,u,d)^A^. In addition, if fmax < +oo, then for every 
M > 0, there exists t e [fo, fmax) with ||r,(f)x||;. — ||0(f,fo,xo, u,d)\\x > M. 

(5) The Classical Semigroup Property: For each t e [fo, fmax), it holds that 
0(f , T, <p{r, fo, Xo, M, rf), M, d) — (pit, fo, ■<'o, u, d) for all r e [fo, f]. 

The reader should notice that Proposition 1.1 guarantees that the "Boundedness- 
Implies-Continuation" (BIC) Property and the Classical Semigroup Property hold 

with fmax = +00. 



1.2.5 Control Systems with Variable Sampling Partition 

Given a pair of sets D C !}{' and U C i){'" with e t/ a closed set, a positive function 
h : Sit"*" xW X U X D ^ (0, r] which is bounded by certain constant r > 0, and a 
triplet of vector fields / : fft+ x !){+ x i)i" x ilt" x {/ x [/ x Z) x Z) ^ D{" , // : !){+ x 
W xU ^ mP, R : m+ xd\" xm" X U X U X D X D ^ dV\ we consider the hybrid 
system that produces, for each (fo, xo) e dl~^ x 9{" and for each pair of measurable 
and locally bounded inputs u : D{+ -^ U and d : M~^ -^ D, the piecewise absolutely 
continuous function t —> x(t) e M", according to the following algorithm: 

Step / : 

(1) Given t,- and x(t,), calculate r,_|_i using the recursive equation 

Ti + l ^ti +/i(T,,x(T,),M(T,),cf(T,)); 
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(2) Compute the state trajectory x(f), t e [t, , t,_|_i) as the solution of the differential 
equation 

x(t) — f{t, Xi,x{t),x{xi), u(t), u{ri),d{t),d{xi))\ 

(3) Calculate x(t,-(_i) using the equation 

x(r/+i) = rUi, lim x{t), x(r,), M(r,+i), M(r,), dixi+i), rf(r,)); 

(4) Compute the output trajectory Y(t), t e [x,, t,+i] using the equation 

Y(t)^H{t,x(t),u{t)). 

For i = 0, we take xq — t^ and x(xq) = xq (initial condition). Schematically, we 
write 

x(t) — f{t, Xi,x{t),x{xi), u(t) , u(xi) , d(t) , d(xi)) t e [x,, r/+i) 

To = ro,r,+i =T/ + h{xi, x(xi), uixi), dixi)), / =0, 1,... 

/ \ (1-57) 

x(xi+i)^ Rixi, hm x(f),x(r,),M(r,+i),M(T,),(/(T,+i),(i(r/)l 

y(r) = //(r,x(0,M(f)) 

with initial condition x(to) — xq e !}{". 

We consider hybrid systems of the form (1 .57) under the following hypotheses: 

(Al) f{t, X, X, XQ, u, Mo, d, do) is measurable with respect to ? > and continuous 
with respect to (x,d,u) eM" x D x U. Moreover, there exists a symmetric 
positive definite matrix P e g{"X" such that for every bounded S C 9i~'' x 
St"*" X S1{" xdi" X U X U, there exists a constant L > such that 

(x — y)' P[f(t, r,x,xo, u, uq, d, do) — f(t, r, 3',xo, m, mq, d, do)) 

for all (t, X, x,xo, m, mq, d, do) e S x D x D and y e !)t". (1.58) 
(A2) There exist functions y e K^, a e Koo such that 

|/(f, T,x,xo,M,Mo,ii, iio)| < y('')fl(kl + kol + |m| + |mo|) 

for all t > X, (t, m, mq, rf, c/o, x, xq) e 9{+ x [/ x [/ x £) x Z) x JH" x 9{" 

(1-59) 

\R{t,x,xo, M, Mo,(i,(io)| < K(0«(kl + kol + l"l + |mo|) 
for all (r, u, mq, rf, ^o, Jc, xq) e !)i+ x C/ x t/ x D x Z) x 9^ x Sit". (1.60) 

(A3) H : di+ X m" xU ^ 'MP is a continuous map with H(t, 0, 0) = for all t > 0, 

(A4) There exists a partition b — {7/},^o °f '^^^ (i-^-' ^^ increasing sequence of 

time instants with To = and 7] -^ +cxd) such that for every bounded S C 

Di"*" X Di" X U X D, there exists i' > with /z(r, x, m, cf) > min{5fe(f) — t, s} 

for all (f , X, M, fif) e 5, where qtit) '■— min{r e b; t < T). 
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Occasionally, we will use the following stronger hypothesis: 

(A5) There exist a positive, continuous, and bounded function hj : !)i"'" x i){" x [/ — >• 
(0, r] and a partition b = {T/I^q of 9J+ such that 

h(t, X, u, d) > min{^fo(r) — t, hi(t, x, m)} 

Wit,x,u,d)em+ xdi" xU X D (1.61) 

where qb(t) '■— min{r e b;t < T}. 

Systems of the form (1.57) under Hypotheses (Al^) arise frequently in certain 
applications in mathematical control theory and numerical analysis. We mention 
here two important applications: 

(1) Application of "sampled-datd" feedback: For example, consider the finite- 
dimensional continuous-time control system x{t) — f(t,x(t),v{t)), where 
x(f) e m", v{t) e m"\ and the vector field / : m+ x d\" x Df" -^ !){" is con- 
tinuous and locally Lipschitz in x e !1t". Suppose that there exists a fam- 
ily of measurable and locally bounded controls t —^ v{t,to,xo) parameter- 
ized by (^o.-'^o) £ ^^~^ X Si" with the following property: for every (fo^-'^o) e 
!){+ X ;){", the unique solution of i(f) — f(t, x(t), v{t, to, xq)) with initial condi- 
tion x(fo) = xo exists for all f > f o and satisfies lim,^+oo -'^(O = e Sit". Then, 
by application of the measurable and locally bounded controls t ^ v(t,tQ, xq) 
on the interval [to, to + h(to, xq)), where h : M~^ x !)i" -^ (0, r] is a positive 
function bounded by certain constant r > 0, we obtain a control system that 
produces for each (to, xq) e iK"*" x 9t" and for each pair of measurable and lo- 
cally bounded inputs u : fft"*" — ^ Dt™, e : !){"'" -^ !)i" the absolutely continuous 
function [fo, +oo) 3 t ^^ x(t) e S)i" that satisfies a.e. the following differential 
equation: 

x{t) ^ f {t , x(t), v{t , Ti , x(ri) + e(ri)) + u{t)) t e [r,-,T,+i) 

To = ro,T/+i =r/ +/z(r/,x(T,) + e(r,)),/ = 0, 1,... (1.62) 

Y{t)^H{t,x(t)) 

with initial condition x(to) — xo- In this case, the measurable and locally 
bounded inputs u : !){''" — ^ dV" and e : ;){+ —>■ M" represent the control actua- 
tor error and the measurement error, respectively. 

(2) Numerical solutions of ordinary differential equations: For example, consider 
the finite-dimensional continuous-time dynamical system x(f) — f(t,x(t)), 
where x{t) e M". Let b = {7]},^o be a partition of flt"*", i.e., an increasing 
sequence of time instants with To — and I) — ^ -l-oo, and define qb(t) :— 
min{r e b; t < T}. Consider the explicit Euler discretization scheme with state- 
dependent (adaptive) time step ;K+ x S)i" 3 (t, x) -^ h{t, x) > that produces 
for each (fo, xq) e ?){'*' x Df the absolutely continuous function [to, +oo) 9 f ^ 
x(f) e 9t" (Euler arc) satisfying the evolution equation with initial condition 
x(fo) —xo, 

X{t) = /(T/,x(Ti)) t e [Xi, T, + l) 

ro^to,ri+i =min{^fc(r,),T,- +/!(t,-,x(t,))}, i =0, 1, ... (1.63) 
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Clearly system (1.63) is a system of the form (1.57). 

Consider system (1.57) under Hypotheses (Al-4). Clearly, under Hypothesis 
(Al), for each pair of measurable and locally bounded inputs u : di~^ -^ U and 
d : ;){+ — > D and for each {to, xq) e !H+ x di", the piecewise absolutely continu- 
ous function t ^- x{t) e 9t" that satisfies (1.57) with initial condition x(ro) = xq is 
unique. 

Standard arguments from the theory of existence of solutions of ordinary differ- 
ential equations (see, for instance, [14]) show that if x(f) is defined for some t > to, 
then there exists e > such that the solution x(t) is also defined for r e[t,t + e). 
Thus, for each (to, xq, u, d) e M~^ x S)i" x Mu x Mq, there exists a maximal exis- 
tence time, i.e., there exists fmax e (to, +oo] for which the solution x(t) of (1.57) is 
defined on [to, fmax) and cannot be continued further. 

We next show that if fniax < +oo, then the solution x{t) of (1.57) cannot be 
bounded on [ro , fmax ) ■ The proof of this implication depends on the following claim. 

Claim Let s > be a constant. Every infinite sequence {t,}^Q with t,+i > 
min{^fo(T/), r,- + s} for each i and tq > satisfies r,- -^ +oo, where qtit) equals 
min{r e b; t < T], and b — {7}}^o '■* the partition involved in Hypothesis (A4). 

Proof of Claim Since qbiji) > t/, it follows that {r,, / = 0, 1, . . .} is an increas- 
ing sequence. Consequently, we have r, -^ supjt/,/ =0,1,...}. Suppose that 
sup{r,, / = 0, 1, . . .} < +00. In this case, there exist N, N > such that Tn, Tn-i e 

jt and 7/v-i < r,- < T^, i — N ,N -\- 1, Thus, we obtain qhir,) — Tf^, i — 

N, N + 1, . . . , and consequently r/_|_i > min{rjv, tj +s], i — N, ff +1, Clearly, 

since t,_|_i < 7w, i — N,N+l,...,it follows that we must have xi + s — 

minfT/v. t; +i'}, / — ff, N + 1, . . . , and this implies t,_|_i > ri+s,i — N, N + 1, 

Thus, we obtain r, > 7V_i + (/ — N)s, i — N, N + I, . . . , which shows that 
sup{r, , / = 0, 1 , . . .} = +00, a contradiction. The proof of the claim is complete. D 

We are now ready to show the required implication. Suppose that rmax < +oo. 
Let {ro = To, ti, . . .} be the sequence of time instants satisfying 

r,_|_i = t/ +/z(r/,x(r/), m(t/), (i(T/)) / =0, 1,2, . . . 

and R :— max{sup{|M(f)|; t e [to, Wx]}. sup{|J(f)|; t e [to, fmax]}}- We consider the 
following cases: 

(1) The cardinal number of the set {to, ti, . . .} is finite. Standard arguments from 
the theory of existence of solutions of ordinary differential equations show that, 
in this case, we have limsup,^,- |x(r)| — +oo. 

(2) The cardinal number of the set {tq, ti, . . .} is infinite. In this case, we have 
supJTo, Ti, . . .} < finax + '"■ However, if x(f) is bounded (say x{t) e B[0, p] 
for some p > 0), then we may define the bounded set S — [to, ?max + r] x 
B[0,p] X Bu[0, R] X Bd[0, R]. By virtue of Hypothesis (A4), there exist a 
partition b — {Ti}f^Q of M"*" and s > with h(t, x, u,d) > min{qb(t) — t, s} 
for all (t, X, u, d) e S. Consequently, it holds that Xi+\ > inm{qb(ri), xi + s]. 
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i —0, 1 , . . . , with To > 0. It follows from the above claim that r, -^ +oo, which 
contradicts the fact that supjto, ti, . . .} < fmax + r < +oo. Thus, we conclude 
that the solution x(t) of (1.57) is not bounded. 

In any case the hypothesis fmax < +oo leads to the conclusion that the solution 
x(t) of (1.57) is not bounded. 

Let Mij and Md be the sets of measurable and locally bounded inputs u : 
Ot"*" — > U and d : 91+ — >• D, respectively. Let : ^40 — >• M" be the mapping 
(p{t,to,xo,u,d) :— x(t) which for each (tQ,XQ,d,u) e Ot"*" x M" x Mq x Mjj 
and t e [?o, fmax) gives the value x(t) e di" of the unique solution of (1.57) with 
x(?o) = .^0 ^nd To = /q > 0- The mapping (p : A^ —^ M" is defined on the set 

(fO,-ico.".'i)e3i+xi1i"xM(; xMo 

It should be clear from all the above that the mapping (f> : A^ —>■ M" is well defined 
and satisfies the following properties: 

(1) Existence: For each (to, xq, d, u) e !){+ x W x Md x Mu , there exists f > ?o 
such that [fo, ?] x {(fo, xc m, c?)} c A^. 

(2) Identity Property: For each (ro, xq, cf, m) e 9i^ x i)i" x Mo x Mjj, it holds that 

0(?O, tQ,XQ, U,d) —XQ. 

(3) Causality: For each {t,tQ,xo,u,d) e A^ with t > to and for each (M,(i) e 
Mf/ X Mo with (u(t),d(t)) — (u{r),dir)) for all t e [?o. ?], it holds that 
(t, to, xo, u, d) e A^ and </>(?, Tq, -'^Oj m, d) — (p(t, to, xq, u, d). 

(4) The '"Boundedness-Implies-Continuation" (BIC) Property: For each (to,xo, 
u,d) e St"'" X ;){" X My X Md, there exists a maximal existence time, i.e., there 
exists fjnax ^ (^0. +oo] such that [fo, fmax) X {('^o. -'^o. W' d)} C Aip and for all 
r > fmax; it holds that (t, to, xo, u, d) ^ A^. In addition, if r^ax < +oo, then for 
every M > 0, there exists t e [to, Wx) with |</>(r, fo, xo, u,d)\ > M. 

An important feature of systems of the form (1.57) under Hypotheses (Al-4) is 
that they do not satisfy the classical "semigroup property": for example, the solu- 
tion x{t) of (1.57) with initial condition x(fo) = xo does not coincide (in general) 
for t > ti > to with the solution x(t) of (1.57) with initial condition x(ti) = x(fi) 
corresponding to the same measurable and locally bounded inputs u : St"'" —y U and 
d : M~^ -^ D. The following example illustrates this point. 

Example 1.2.5 Consider the following system: 

x(r) = -x(T/) f e [t/,t;+i) 

t,+i = t,- + 1 

x(t) e m (1.64) 

with initial condition x(fo) — xq &M and To = f o > 0- In this case we can determine 
analytically the transition map for all t > to (u,d in this example are irrelevant): 

^ f(l-r + fo)-^o forr e[fo,fo + l) 
(p(t,to,xo)^ \ 

for f > fo + 1 
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It is clear that the state space is Dt and that the classical semigroup property does not 
hold for this system, i.e., the property 

"for each t e [Iq, fmax)> it holds that 

(pit, r,(t>(r,to,xo)) — ^it,to,xo) for all r e [to, t]" 
(Classical Semigroup Property) 

does not hold. However, notice that the equality 0(r, r, 0(r, ro,-'^o)) = 
(/>(?, to, xo) holds if T e nito, xo) — {to, ^o + 1> ^0 + 2, . . .}. 

Let jT(to,xo,u,d) C [to, +00) be the set of the sampling instants, i.e., 
7T(to, Xo, u, d) — {r,}^Q, where the sampling instants are generated by the recur- 
sive relation t,+i = t; + h{xi,x{xi), u{xi), diji)), / = 0, 1, . . . , with to — to- Then 
the following property holds: 

(5) Weak Semigroup Property: There exists a constant r > such that for each 
t >to with it, to, Xo, u, d) e A^: 

(a) (t, to, xo, u, d) e A^ for all t e [to, t], 

(b) (f>{t, r, (f>{x, to,xo, u, d), u, d) — (pit, to, xo, u, d) for all x e [fo, f] n ji(to, 
Xo, u, d), 

(c) if (t + r, to, xo,u,d) e A^, then it holds that Tt{to, xo, u,d)r\[t,t -\-r]^9, 

(d) for all r e nito, xo, u, d) with (t, to, xo, u, d) G A^, we have 7r(r, (pix, to, 
xo, u, d), u, d) — 7T(to,xo, u,d) n [r, +00). 
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Based on the examples of the previous section, we want to introduce the notion of 
a deterministic control system. Notice that a more relaxed notion of a deterministic 
control system will be adopted here than what has been widely used in past liter- 
ature. This extension allows us to consider the important class of control systems 
with variable sampling partition. 

Definition 1.1 A deterministic control system E :— {X,y,Mu,Mo,(p,Jt,H) 
with outputs consists of 

(i) a set U (control set) which is a subset of a normed linear space U with e t/ 
and a set My C A1(C/) (allowable control inputs) which contains at least the 
identically zero input mq e Mjj, (i.e., the input that satisfies mo(0 = e t/ for 
all t > 0); 

(ii) a set D (disturbance set) and a set Mq C /A{D), which is called the "set of 
allowable disturbances"; 

(iii) a pair of normed linear spaces X and y called the "state space" and the "output 
space," respectively; 

(iv) a map H : St"*" x X x U ^ y that maps bounded sets of D{+ x X x U into 
bounded sets of y, called the "output map"; 
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(v) a set-valued map D{+ x X x Mu x Mo 3 {tQ,XQ,u,d) —>■ 7T{tQ,XQ,u,d) C 
[fo, +oo), with to e 7r(fo, xq, u, d) for all (rg, xq, u,d) e ilt"*" x X x My x Md, 
called the set of "sampling times"; and 
(vi) the map (p : Afj, ^ X, where A^ c ;){+ x Di"*" x X x Mu x Md, called the 
"transition map," which has the following properties: 

(1) Existence: For each {to,xo,u,d) e i)i+ x ^Y x Mu x Mo, there exists t > to 
such that [^0, t] x (to, xo, u, cf) C A^. 

(2) Identity Property: For each (to,xo,u,d) e ?){+ x A:" x Mu x Mo, it holds 
that (f>{to, to, Xo, u,d) — XQ. 

(3) Causality: For each {t, to, xo, u, d) e A^ with t > to and for each (u, d) G 
Mu X Mo with (u(x), d{x)) — (u(r), d(x)) for all t e [fo, t], it holds that 
(f, to,xo, a, d) e A^ with 4>{t, to,xo, u,d) — 4>{t, to,xo, u, d). 

(4) Weak Semigroup Property: There exists a constant r > such that for each 
t > to with (t,to,xo,u,d) e A^: 

(a) (r, to, xo, u, d) e A^ for all r e [to, t], 

(b) (p(t, r, (/>(t, to,xo, u, d), u,d) — (p(t, to,xo, u,d) for all r e [to, t] n 
7r(fo, Xo, u, d), 

(c) if {t + r,to,xo,u,d) e A^, then it holds that jt{to,xo,u,d) n 
[f,r + r]^0, 

(d) for all r e n{to,xo,u,d) with (t, fo>-<^o>M,d) e A^, we have 
n{x, 4>(x, to, Xo, u, d), u, d) — itito, xo, u, d) C\ [r, -|-c>o). 

A deterministic control system E :— (X, y, Mu, Mo, 4>, it, H) with no external 
inputs, i.e., U — {0}, is called a deterministic dynamical system. 

A deterministic control system E :— {X,y, Mu, Mo,(p,yt, H) with (pit, to, 
x,u,d)—x for all (fo, x, m, cf) e S){+ x <¥ x Mu x Mo, t > to, and H : 9t+ x [/ ^ 3^ 
(i.e., the output is independent of the state) is called a static map. 

Definition 1.2 A deterministic control system E :— {X,y,Mu,Mo,(p,Jt,H) 
with outputs is called T -periodic for some constant T > if 

(a) H{t + T, X, u) = H{t, X, u) for all (t, x, u) e !1{+ x X xU; 

(b) for every (u, d) e Mu x Mo and integer k, there exist inputs PtTU e Mu and 
Pkid e Mo with {PkTu){t) = u{t + kT) and {PkTd){t) = d{t + kT) for all 
t + kT>Q; 

(c) for each {t,to,xo,u,d) e A^ with t > to and for each integer k with 
fo — kT > 0, it follows that (f — kT,to — kT,xo, PkTU, Purd) e A^ and 
TT(to-kT,xo, PkTU, ^<:7-<^) = UTe;r(fo,jco,«,rf){^ - kT) wUh^ (j){t , to, Xo, u, d) = 
(p{t — kT, to — kT, Xo, PkTU, PkTd). 

Definition 1.3 A deterministic control system E :— {X,y,Mu,Mo,(p,Jt,H) 
with outputs is called time-invariant, or autonomous, if it is T-periodic for all T >Q. 

Remark 1.3 (a) Section 1.2.1 shows that systems (1.3) described by ODEs under 
(H1)-(H4) define deterministic control systems E :— {X,y,Mu,Mo,(p,TX,H) 
with X = 9f' and y^m''. If the mappings / : 9{+ x 9t" x t/ x D ^ 9t" and 
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H : i)}"*" X ;){" X U ^ di^ are r-periodic with respect to t, then system (1.3) is 
T-periodic. Moreover, if the mappings / : D{+ x di" x U x D ^ M" and H : 
JH"*" X 9i" X [/ — )• !){^ are independent of t, then system (1.3) is autonomous. 

(b) Section 1.2.2 shows that systems (1.10) described by RFDEs under Hypothe- 
ses (Sl^) define deterministic control systems E :— {X,y, Mu, MD,(f),7T, H) 
with X = C°([-r, 0]; M"). If the mappings / : m+ x C°{[-r, 0]; !H") xU x D^ 
m" and H : ;)i+ x C°([-r, 0]; d\") x U -^ y slk T-periodic with respect to t, then 
system (1.10) is T-periodic. Moreover, if the mappings / : di~^ x C'^([—r, 0]; di") x 
U X D^ !){" and // : 9{+ x C°([-r, 0]; 9t") x U ^ y are independent of t, then 
system (1.10) becomes autonomous. 

(c) Section 1.2.3 shows that systems (1.18), (1.19), (1.20) described by coupled 
RFDEs and FDEs under Hypotheses (Pl-5) define deterministic control systems 
S := {X, y, Mu, Mz), 0, TT, H) with X = C°([-ri, 0]; ;«"') x £^^([-^2, 0]; m"^-). 
If the mappings /,- : {Jr>oi'} ^^x C^(i-ri,0]; d\"') xC'^{[-r2 + rit),0]; JR"^) x 
U -^ M"', / = 1, 2, H : 9f{+ X C°([-n,0]; !)i"') x jC°^([-r2, 0]; 9{"2) x U ^ y, 
and T : !){"'" ^ (0, +oo) are T-periodic with respect to t, then system (1.18), 
(1.19), (1.20) is r-periodic. Furthermore, if the mappings /, : Ur>of'! ^ D x 
C°([-ri,0];i){"0 X jC°°i[-r2 + r(0, 0]; i)i"2) x [/ -> 9t"', / = 1,2, H : 9{+ x 
C°([-ri, 0]; ;K"0 X £~([-r2, 0]; di"^) x U ^ y , and t : 9t+ ^ (0, +oo) are in- 
dependent of ?, then system (1.18), (1.19), (1.20) is autonomous. 

(d) Section 1.2.4 shows that systems of the form (1.42) described by FDEs un- 
der (Q1)-(Q3) define deterministic control systems S :— (X, y, My, Mo, (p, tt, H) 
with X being the normed linear space of bounded functions x : [— r, 0] ^^ 9t" with 
norm ||x||;f — sup_^<^<o k(t)|. If the mappings / : Ur>o{^! x D x B(t) x U ^ 
d{'\ X : m+ -^ (0, +oo)", and H : m+ x X x U ^ y, where B(t) denotes the set 
of all bounded mappings x : [—r + r(t),Q] ^ 9{", are T-periodic with respect to 
t, then system (1.42) is T-periodic. Moreover, if the mappings / : Ur>o{^} x D x 
B(t) X [/ -^ 9{", T : 9{+ -^ (0, +oo), and H ■.di+ x X xU ^y are Independent 
of t, then system (1.42) is autonomous. 

(e) Section 1.2.5 shows that systems of the form (1.57) described by ODEs under 
(A1)-(A4) define deterministic control systems S := {X,y,Mij,MD,(j),n,H) 
with X = 9r and y = mP . Notice that if h(r + T, x, u, d) = h{r, x, u, d), f(t + 
T,x -\- T,x, xo,u,uo,d,dQ) — f{t,r,x,XQ,u,UQ,d,do), R(r + T,x,xo,u,uo, 
d, do) — R(r, X, xo, u, mq, d, do) and H{t + T, x, u) — H(t, x, u) for certain T > 
and for (r, r, m, uq, d, do, x,xo) em+ xm+ xU xU x Dx OxM" x 9{" with r > r, 
then system (1.57) is T-periodic. Furthermore, if h{r,x,u,d) — h{x,u,d) and if 
f{t, r, X, Xo, u, Mo, d, do) — f(t — r, x, xo, u, uo, d, do), R(t:, x, xo, u, mq, d, do) = 
R(x, Xo, u, Mo, d, do), and H(t, x, u) — H(x, u) for (t, r, u, uo, d, do, x, xo) G Sf"*" x 
OJ"*" xUxUxDxDxM"x 9t" with t >r, then system (1.57) is autonomous. 

We next give definitions of some important classes of control systems. 

Definition 1.4 Consider a control system E :— (X, y, Mu, Mo, (f>, Jt, H) with out- 
puts. We say that system E: 
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(1) satisfies the "Boundedness-Implies-Continuation" (BIC) property if for each 
(tQ,XQ,u,d) e iK"*" X X X Mu X Mo, there exists a maximal existence time, 
i.e., there exists fmax e (to, +oo] such that [to, fmax) x {(to, xq, u, d)} c A^ and 
for all t > fmax, it holds that (t, to, xq, m, d) ^ Acj,. In addition, if fmax < +oo, 
then for every M > 0, there exists t e [to, fmax) with \\(f>(t, to, xo, u, d)\\x > M; 

(2) is robustly forward complete (RFC) from the input u e Mjj if it has the BIC 
property and for every R>0,T>0,it holds that 

sup{||(/)(fo + .j,fo,xo,M,fif)||^; u eM{Bu[0, R]) nMu,s e [0, T], 
\\xo\\x<R,toe[0,T],deMD} < +oo. 

Remark 1.4 Consider a control system E :— {X, y, Mu, Mo, </>, Tt, H) with the 
BIC property. It follows that E satisfies the (classical) semigroup property (see 
[21, 22, 46]) if the weak semigroup property holds with 7r(fo, xo,u,d) — [to, fmax), 
where fmax e (to, +oo] is the maximal existence time of the transition map for E 
that corresponds to (fo, xq, u,d) e St"*" x X x Mu x Mo, i.e., 

"for each t e [to, fmax), it holds that 

4>(t, r, 4>(r, to,xo, u, d), u,d) — (p(t, to,xo, u,d) for all r e [fo, f]" 
(Classical Semigroup Property) 

Notice that the RFC property is more demanding than the BIC property. All classes 
of systems presented in the previous section satisfy the BIC property. However, only 
for systems described by FDEs of the form (1.42) under Hypotheses (Ql), (Q2), we 
can prove that the RFC property holds. Indeed, the following result guarantees the 
RFC property for systems described by FDEs. 

Theorem 1.2 Consider the control system E :— (X,y,Mu,Mo,(p,Tt,H) de- 
scribed by (1.42) under Hypotheses (Ql), (Q2), where X is the normed linear space 
of bounded functions x : [— r, 0] — >■ 3t" with norm \\x\\x — sup_^<^<o |x(t)|. For 
every T >0, there exists Gt & Kqo such that the following estimate holds for all 
R>0: 

sup{\\(l)(to+s,to,xo,u,d)\\-^;u e M{Bu[0, R]) nMu,s e[0, T], 

IkollA' <R,toe [0, T],deMo}< Gt(R) (1.65) 

Proof Let T >0, R >Ohe given and define 

j=min{T(f):f e[0,2r+r]} (1.66) 

By virtue of (Ql), it follows that s > 0. Consider the solution of (1.42) with initial 
condition Tr(to)x — xo & X corresponding to inputs u e M(Bu[0, R]) n Mu,d e 
Mo and such that ||xo||a' < R,to e [Q,T]. Hypothesis (Q2), in conjunction with 
definition (1.66), implies that, for all f e [fo, fo + 7"], 

sup |.^(t)|<a( sup |x(T)||+a(^) (1-67) 
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where 5(3;) :— a(y ma.xo<t<2T+r Pit)), 0iy) '■— y +'2.a{y), and 

maxji?, sup |j:(r)| 1 < 0( max! /?, sup |x(t)|!| (1.68) 

' to-r<T<t+s ' ^ ' to-r<T<t J^ 

Inequality (1.68) and induction arguments show that the following estimate holds 
for all integers /' > with js < T: 

maxf/?, sup \xir)\\<e'^'+^HR) (1-69) 

' ro-'-<T<ro+(./+l).s 

where 0^'^ — o ■ ■ ■ o0. It follows from (1.69) that inequality (1.65) holds with 

J times 

Gt —O'-'K where / = [ — ] + 1. The proof is complete. D 



1.4 Equilibrium Points 

The following definition clarifies the notion of an equilibrium point for control sys- 
tems with outputs in the sense of Definition 1.1. 

Definition 1.5 Consider a control system E :— iX,y, M{j, Md,(P, it, H) and let 
mq € Mu be the identically zero input, i.e., mo(0 — for all f > 0. Suppose that 
Hit, 0, 0) = for all f > 0. We say that e A:" is a robust equilibrium point from the 
input u e Mu for U if 

(1) for every (t,to,d) e ?{+ x Dt+ x Md with t > to, it holds that (pit, to, 0, 
uo, d) — 0; 

(2) for all e > and T, h e Di"*", there exists S :— S{s, T,h) > such that for all 
(to,x,u) e[0,T]xX xMu andr e [to,to + h] with ||x||;t'-|-sup,>o ||M(f)||t/ < 
S, it holds that (r, to, x, u, d) e A^ for all d e Mo and 

sup{||(/>(T, fo,-«, u,d)\\^;d e Mo, r e [to, to + h], to e [0, T]] < e. 

The reader should not be surprised by the previous definition of a robust equilib- 
rium point. The usual definition of equilibrium point does not require property (2) 
of Definition 1.5 to hold. However, in most cases the control systems studied satisfy 
the property of continuous dependence on the input and initial conditions of the 
transition map, i.e., 

for each (t, T, xo, u) e di~^ x di~^ x X x Mu with t > T and for every e > 
0, there exists ^ > such that for every ix,v) e X x My with ||x — xo\\x 
+ sup,>Q II ^(r) — uir)\\if < S and for every (fo, d) e [0, T] x Mjj with (f, to, xo, 
u, d) e A^, it follows that {t, to, x, v, d) e A^ and 

sup{||(/)(r, to,x,v,d)—(pir,to,xo,u,d)\\.^;ito,d)e [0, T] x Md, 
X e [to, t] with it, to, xo, u, d) e A^} < e 
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It can be immediately verified that if the transition map depends continuously on 
the input and initial conditions, then the usual definition of an equilibrium point is 
equivalent to Definition 1.5 (since property (2) of Definition 1.5 is automatically 
satisfied). Since our effort is to provide results for systems that do not necessarily 
satisfy the property of continuous dependence on the initial conditions, we do not 
assume this property. 

Definition 1.5 clarifies the main reason for which there is a distinction of the 
inputs acting on the system in Definition 1 . 1 of control systems ("inputs" and "dis- 
turbances"). The inputs that belong to the "set of allowed disturbances" (Mq C 
A4(D)) do not alter the position of equilibrium points. On the other hand, inputs 
that belong to the set of "allowable control inputs" (Mj/ C A^(t/)) are allowed to 
alter the position of equilibrium points. This reminds the difference between "addi- 
tive" and "multiplicative" uncertainties in linear system theory. 

Example 1.4.1 (Robust equilibrium points for control systems described by ODEs) 
Consider system (1.3) under Hypotheses (Hl-4). Since f{t,0,0,d) = for all 
it, d)em+x D, it follows that 0(r, to, 0, mo, d)^Oe M" for all (to, d) e di+ x Md 
and t > tfj. Let s > 0,T,h e di~^ (arbitrary), and let S :— S(s, T,h) > be the unique 
solution of the equation 

|exp(/,(|- + l)).^ + |^exp(.(|- + l)Y^ rn..^ jit))\aiS)f . ^ 

(1.70) 

where L := L(T + h,s), L(-) is the function involved in (1.1), A'l, ^"2 > are 
constants that satisfy ^i|x|^ < x'Px < K2\x\^ for all x e di" for the symmetric 
positive definite matrix P e fj{"^" involved in Hypothesis (HI), and y e K'^ and 
a e KoQ are the functions involved in Hypothesis (H3). We next show that property 
(2) of Definition 1.5 holds with 8 := 8{s, T,h)>0 defined by (1.70). Notice that 
since system (1.3) under Hypotheses (Hl-4) satisfies the BIC property, it suffices 
to show that, for all (xq, u) e S){" x Mfj with |xo| + sup,>Q \u(t)\ < S, it holds that 
sup{|(/)(r, ro^-'^o, u,d)\; d e Md, r e [to, to + h],to e [0, 7^]} < e. 

The proof will be made by contradiction. Suppose that there exists (xo, u) G 
Df X Mu with |xo| + sup,>o \u(t)\ < 8 and 

sup{|(/)(r, to,xo, u,d)\; d e Mo, r e [to, to + h\, to e [0, T]\ > e 

Consequently, there exist d e Md, to e [0, T], and t e [to, to + h] with \x(t)\ > ^ 
(where x{t) — (p(t, to, xo, u, d)). Consider the nonempty set A — {t>to'. \x(t)\ > 
y}. Let ti — inf A. Notice that since |xo| < 5 < | and \x(t)\ > ^, it follows that 
fi > to and t[ < to + h. Furthermore, by virtue of definition ti — inf A, we have 
|x(fi)| — Y ^nd |x(f)| < e for all t e [to, ti]. In this case, we consider the abso- 
lutely continuous function V{t) = x'{t)Px(t), which by (1.1) satisfies the following 
inequality a.e. for t e [to, fi]: 

Vit) < L\xit)\^ + 2x'{t)Pf[t, 0, u(t), d(t)) (1.71) 
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With (1.71), using the inequalities 2x'Pf{t, 0, u, d) < x'Px + f'{t, 0, u, d)Pf(t, 0, 
u,d), Ki\x\^ <x'Px <K2\x\^, and |/(f, 0, m(0,^(0)I < Y{t)a(\u\) <Y{t)a{S), 
we conclude that the absolutely continuous function V{t) — x'(t)Px(t) satisfies the 
following inequality a.e. for t e [to, ti]: 

V(t) <(^^+l) V{t) + K2y\t){a(S)f (1.72) 

The above differential inequality, in conjunction with the inequality ^i|x|^ < 
x'Px < K2\x\^, implies that, for all t e [to, ti], 

|x(Or<|exp(/.(|- + l)).^ 



K2 



Ai^.^'))L?ihJ^'^y^''^'^y 



The previous inequality in conjunction with (1.70) implies |.x(fi)| < |, which con- 
tradicts the fact that |jc(fi)| = ^. 

Thus we conclude that e !){" is a robust equilibrium point for system (1.3) under 
Hypotheses (Hl-4). 

Example 1.4.2 (Robust equilibrium points for control systems described by RFDEs) 
Consider system (1.10) under Hypotheses (Sl-4). Since f(t,0,0,d) — for all 
{t,d) e 9t+ X D, it follows that (p(t,to,0,uo,d) = e C°([-r,0]; 91") for all 
(to, d) e 9t+ X Md and t > to- Let e > 0, T,h e 9{+ (arbitrary), and let S := 
S{s, T,h) > be the unique solution of the equation 

^txp(^^^-^h)(&^+h( max y(0)'(«(3))') = ^ (1.73) 

Ki \ ■'^l / ^ \0<t<T+h / ^ ' / 4 

where L :— L(T + h,£), L(-) is the function involved in (1.8), Ki, K2 > are 
constants that satisfy -^Tilx]^ < x'Px < K2\x\^ for all x e di" for the symmetric 
positive definite matrix P e 5)^"^" involved in Hypothesis (SI), and y e K~^ and a e 
A'oo are the functions involved in Hypothesis (S2). We next show that property (2) 
of Definition 1.5 holds with S :— S(e, T, h) > defined by (1.73). Notice that since 
system (1.10) under Hypotheses (Sl-4) satisfies the BIC property, it suffices to show 
that for all (xq, m) e C°i[-r, 0]; 9{") x Ma with \\xo\\r + sup,>o \u{t)\ < S, it holds 
that mp{\\(p(r, to, xo, u, d)\\r; d e Md, r e [to, to + h], to e [0, T]} <£. 

The proof will be made by contradiction. Suppose that there exists (xo, u) G 
C°([-r, 0]; W) X My with ||xo||, + sup,>o \u{t)\ < 8 and 



sup{||</>(T,ro,Jco,M,fif)||^;cf e Md, r e [to, to + h], to e [0, T]] 



> s 



Consequently, there exists d e Md , to e [0, T] and t e[to,to + h] with || 7]- (t)x \\r > 
^ (where Tr{t)x — (j){t,to,xo,u,d)). By virtue of Lemma 2.1, p. 40 in [14], 
we know that the mapping r -^ \\Tr{x)x\\r is continuous on [fo>f]- Consider the 
nonempty set A = {r > fo : l|7r(r)x|| > ^}. Let t\ — inf A. Notice that since 
Ikollr <8 <j and ||7;.(f)x||,- > ^, it follows that t\ > to and fi <to + h. Further- 
more, by the definition of fi — inf A, we have ||rr(fi)x||r = ^ and ||T';-(r)x||r < e 



1.4 Equilibrium Points 35 

for all T e [to,ti]. In this case, we consider the absolutely continuous function 
V{t) — x'(t)Px(t), which by (1.8) satisfies the following inequality a.e. for t e 
[tQ,ti]: 

V(t) < L II Tr(t)x 1^ + 2x'(t)Pf(t, 0, M(f), ^(0) (1.74) 

With (1.74), using the inequalities 2x'Pf(t, 0, u, d) < x'Px + f'{t, 0, m, d)Pf(t, 0, 
u,d), Ki\x\^ <x'Px <K2\x\-, and \f{t,Q,u{t),d{t))\ < y(r)a(|M|) < ]/(r)fl(^), 
we conclude that the following inequality holds for all t e [fo, ?i]: 



I ,2 L + K2 

k(0 < 



/■ II Ii2 ^2 9 ^2/ \2, s2 

/ 7;(r)x 'fifr + -^||xo||2 + /!-^ max y(0 a (3)^ 



The above integral inequality gives for all t e [to,ti]: 



I II 2 L -\- Ki /" II II 2 Ki T 

\Tr{t)x\\ < I r^(T)x fi;r + — IIjcoII, 

J<-1 Jto J^l 



h'-^i max y(f)) (fl(5))' (1.75) 



Kit \2 

! — I max Y{t) 

Ki \0<t<T+h I 

Inequality (1.75) in conjunction with the Gron wall-Bellman lemma implies that 

||r.(0x||^<|^exp(^/z)(||xo||^ + /,(^^max^^y(0)'(«(5))^) 

for all? e [?o,?i]- 

The previous inequality in conjunction with ||xo||^ < 5 and (1.73) implies 
l|7;-(?i)-«llr < |, which contradicts the fact that ||7;.(fi)x||,. — ^. 

Thus, e C^i\—r, 0]; !){") is a robust equilibrium point from the input u e Mjj 
for system (1.10) under Hypotheses (Sl-4). 

Example 1.4.3 (Robust equilibrium points for control systems described by cou- 
pled RFDEs and FDEs) For systems described by coupled RFDEs and FDEs of 
the form (1.18), (1.19) under Hypotheses (Pl-4), the fact that (0, 0) e C°([-ri, 0]; 
S){"') X C°°{[—r2, 0]; M"^) is a robust equilibrium point from the input u e Mjj fol- 
lows from the following result. 

Theorem 1.3 Consider system (1.18), (1.19) under Hypotheses (Pl-4). Then 
for all £ > and T,h e S){^, there exists S :— 8{e,T,h) > such that for 
all (to,xw,X2o) e [0,T] X C°([-n,0];9ri) x £°°([-r2, 0]; !){«2) and {u,d) e 
£j^^(3t+; U) X -Ci^(,(9t'''; D) with HxioHr, + \\x2o\\r2 + sup,>o |m(OI < S, there exist 
tmax S (^0 + h' +oo] and a unique pair of mappings x\ e C*'([?o — r[, fmax); 9t"')> 

X2 e >Cj~ ([fo - r2, ^max); i^t"") with Tr, {to)xi = Xio, Tr2(tQ)X2 = ^20, Xi € C°([to - 

'"ii ^max); 9t"') being absolutely continuous on [to, ?max), such that (1.18) holds a.e. 
for t G [fo, Wx), (1-19) holds for all t e (fo, fmax), and 

sup{ II Tr, (t)xY 1^.^ + II r,2(f)x2||^^; t e [to, to + h]]<s. (1.76) 

For the proof of Theorem 1 .3, we need the following technical lemma. 
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Lemma 1.1 For all s > and T e S){+, there exists S :— S{s, T) > such that 
for all (fo,^io,-«2o) e [0, T] x C°([-ri,0]; W^) x C^([-r2,0]; m"^) and{u,d) e 
£j^j,(J)t+; U) X £[^p(i)t+; D) with ||xio||,-, + |k2oll/-2 + sup,>o \u(t)\ < S, there exist 
Wx e (?o + h, +oo], where h :— h(T) — min(l; m\n{t{s) : s e{Q),T + 1]}), and a 
unique pair of mappings x\ e C°([fo -/"i , ^max); ^"^), X2 e ^^^.([fo -''2, fmax); ^"') 
with Trj (to)xi — xio, Ti.2(to)x2 = X2o such that (1.18) holds a.e.for t e [to, fmax), 
(1.19) holds for all t e (to, fmax), ond (1.76) holds. 

Proof Without loss of generality, we may assume that the function a e K^o involved 
in Hypothesis (P2) satisfies a(s) > s for all i' > and that the function fi e K^ 
involved in Hypothesis (P2) is nondecreasing with P(t)> 1 for all r > 0. Let e > 0, 
r e 9t+, and define 

3(e, r):= a" ,/ — ^ ^a" - (1-77) 

,6(r+l) \^ K2 Ap(T + \) \9)) 

where L{e,T) is the constant that corresponds to the bounded sets / := [0, T + 
1] C J){+, ^ c {xi e C°([-n,0];9{"i) : ||xi||,i < e} x {x2 e /:~([-r2,0]; Di"^) : 
I|x2||r2 < e} X {m e t/ : |m| < e} and satisfies (1.21), and A"!, ^"2 > are constants 
that satisfy A'llxp < x'Px < ^"21x1^ for all x e !){"' for the symmetric positive 
definite matrix P e Of{"i^"i involved in Hypothesis (P4). 

Let (ro,xio,x2o) e [0, T] x C°([-n,0]; dl"') x C°^i[-r2,0]; 9i"2) and {u,d)e 
CZiy^+; U) X C^jm+; D) with llxiolln + ll^2ollr2 + sup,>o W{t)\ < ~S (but oth- 
erwise arbitrary). By Theorem 1.1, there exist fmax e (to, +c»] and a unique pair 
of mappings xi e CO([fo - n, Wx); ?)i"'), X2 e £~([fo - ^2, Wx); iH"^) with 
r^j (fo)xi — xio, Tr2(to)x2 — X20, xi being absolutely continuous on [to, ?max)> such 
that (1.18) holds a.e. for t e [fo, Wx) and (1.19) holds for all t e (fo.Wx)- In 
addition, if f^ax < +00, then for every M > 0, there exists t e [to, ?max) with 

II r„(f )xi||„ >M. 



Define the set 



A. 



re[fo,fmax): 7>,(f)xJI > „,^ , , fl~M - (1.78) 



|''i 



.6(7^ + 1) 



We distinguish two cases: 

(1) An[to,to + h]^0; 

(2) An[to,to + h]^0. 

Case 1: We will show that (1.76) holds in this case with & :— S(£, T) > as defined 
by (1.77). If A n [to, to+h]^ 0, where h := h(T) = min(l; min{r(5) -.s e[0,T + 
1]}), then xi is bounded on [to, to + h], and consequently we have fmax > to + h. 
Moreover, by virtue of Hypothesis (P2), we have, for all t e [to, to + h], 

\x2(t)\<a{p(t)\\Tr,(t)xil.^)+a{fi(t)\\Tr2-r(,){t-r(t))x2l.^_^^,^) 

+ a{P(t)\u(t)\) (1.79) 

Since An [to, to + h] = (which implies a (/J(f)||rr, (f)xi ||,.,) < | for all f e [to,to + 
h]; see (1.78)), ||x2olla ^ ^ (which implies a(P(t)\\Tr2-T(t)(t - r(ty)x2\\r2-T(t)) < 
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I for all t e [tQ,to + h]; see (1.77)), and sup,>g|M(f)| < S (which implies 
a(P(t)\u(t)\) < I for all t e [to, Iq + h]; see (1.77)), from (1.79) we obtain 

\x2(t)\<- forallr e [fo,fo + /i] (1.80) 

Inequality (1.80), in conjunction with the fact that ||x2o||r2 < ^ < f and the assump- 
tion A n [fo, fo+Zj] — (which implies Hr,., (f)xi ||f[ < fl(y6(OI|7'n(0^i llr,) - | ^r 
all t e [tQ, to + h]), shows that (1.76) holds in this case. 

Case 2: We will show that this case cannot happen by contradiction. Assume 
that Ar\[to,to + h]y^& and define fi — infA. By continuity of the mapping 
t ~^ \\Tri(t)xi\\ri and since ||xio||ri < ^ < WfTi)'^~^^^^' ^^ follows that t\ > to- 
Hence, by continuity of the map t —^ \\Trj (t)xi H^, and definition (1.78), we have 
||T'rj(fi)xi llr, = „,y, j, a~^(|). Evaluating the derivative of the absolutely continu- 
ous map V(t) — x[(t)Pxi{t) on [fo, fi], in conjunction with Hypothesis (P4), gives 

— V(t)^2x[(t)Pfi{t,d(t), Tr,{t)xu Tr^-T(t){t - r(r))x2, u{t)) 

<2L||7>,(0xi||J^ 

+ 2x[{t)Pf^{t,d(t),Q,Tr,_-,(,){t - x(t))x2,u(t)) (1.81) 

where L is the constant that corresponds to the bounded sets / := [0, T + 1] C Ot"*", 
^ C {xi e €"([-0,0]; !){«') : ||xi ||„ < e) x [x2 e /:~([-r2, 0]; 9{"2) : \\x2\\r2 < s) 
x{m e £/ : |m| < e} and satisfies (1.21). Inequality (1.81), in conjunction with 
Hypothesis (P2), the inequality 2x[Pfi < K2\xi\^ + K2\fi\^ and the facts that 
IU'2ollr2 < ^ (which implies 

f^exp(-to±^) 
a{m\\Tr,-M^-r(t))x2l^_,,,)<^^^ \p^tI\^ --' 

for all t e [to,to + h]; 
see (1.77)) and sup,>o \u(t)\ < S (which implies 




a(B(t)\u(t)\) ,, 

for all t e [to, to + h] see (1.77)), gives 

, exp(-2^±^)/ ,/e\\2 

V(t) < 2{L + K2) II T,, it)x, II J_ + K, ^^2^^^\^' [a-' (^ j j a.e. 

on[to,ti] (1.82) 

Integrating both sides of (1.82) and using ^"1 \x\^ < x' Px < K2\x\^, we get, for all 
te[to,ti]. 
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I 1 2 -^2 I 1 2 L -\- Kj /" II II 2 

\x\it)\ <-^xi(fo) +2 — / \\Tri{s)xx\\ ds 

K-l K-\ Jtn 



to 
L+K2 \ , / \\2 



exp(-2^)/_^^. 



«"U (1-83) 

[lowing inequality is a direct conse( 
[to, til- 



The following inequality is a direct consequence of (1.83) and holds for all t e 



I II 2 -^2 II II 2 L -\- K2 f :: II 2 

Tr, it)xi L, < -— Tr. {tQ)xi ,.^ + 2 / Tn (s)xi ^^ ds 



4/i2(r + i) V V9;; 

Since the map t —>■ \\Tr^ (f)xi H^ is continuous and (1.84) holds on [to, ?i], we may 
apply the Gronwall-Bellman lemma. We obtain, for all t e [to,ti], 

„ „ [k^ /L + K2\n II 1 i/e\ 

r,-,(f)-*:i <./ — exp \\\Tnito)xA + fl"M - (1-85) 



Since ||.x-io||r, < S (which implies ||i;.i(fo)-^illn < ^J ^-^^(tTi)~''~^^^^^' ^™™ 
(1.85) we get 

\\Tn(ti)xi\\ < fl-M - I < a"M-l (1-86) 

Inequality (1.86) contradicts the equality Hr,-! (fi)-^ill>-i — ■fl?T+n'2~'(|)- Thus, the 
case A n [to, to + h]^0 cannot happen. 

The proof is complete. D 

We continue with the proof of Theorem 1.3. 

Proof of Theorem 1.3 Consider the sequence {TII^q generated by the recursive 
relation 

To = r > 

(1.87) 
Ti+i = r, + min(l; min{T(i) :s e[0, T, + 1]}) / = 1, 2, . . . 

A standard contradiction argument shows that lim 7} — sup 7} = +00 for all Tq > 
0. Consequently, given arbitrary T, h e di~^, there exists some nonnegative integer 
l(T, h) such that the sequence {Ti]fto defined by (1.87) with the initial condition 
To — T satisfies Tj > T + h for all i > l(T, h). The following fact exploits the 
properties of the sequence {7;}^o defined by (1.87). 

Fact For all s > 0, 7" e St"*", and nonnegative integers i, there exists 5/ \— 
Si(s,T) > such that for all (?o,xio,X2o) e [0,7] x C°([-ri, 0]; Df") x 
>C~([-r2,0];9t"2) and (u,d) e £~ (9i+; t/) x /:~ (!){+; D) with ||xio||n + 



1.4 Equilibrium Points 39 

||x2o||r, + sup,>Q \u{t)\ < Si, there exists fniax ^ (^0 + h, +oo], where h :— h(T) — 
r, -I- 1 — r , { TJ } J^Q is the sequence that satisfies ( 1 . 87), and a unique pair of mappings 



x\ 



1 e Cato - ri , Wx); ai"'), ^2 e A~c(['o - ri, Wx); ai"^) w/f/i r„ (?o)xi = ^lo, 

Tr2(to)x2 — X20 iMc/; that (1.18) holds a.e. for t e [fo, ?max), (1-19) holds for all 
t e {to, fmax), ««<J? (1-76) holds. 

The proof of the fact will be made by induction. By virtue of Lemma 1 . 1 it is clear 
that the fact holds for ; — 0. Suppose that the fact holds for a certain nonnegative 
integer /. Let s > 0, T e di~*~, and define 



(5,+i(e, T) :=min 



Siis, T); Si( ^S(£, Ti+i), tX, ^8(£, Ti+i) \>0 (1. 



Next consider the solution xi e C^([to - ri, f,nax); S^t"'), X2 e C^^([to - n, ^max); 
9t"2) of (1.18), (1.19) with Tr^{t{))x\ — xiq, Tr2{to)x2 — X2Q corresponding to inputs 
(M, d) e /:^,(9t+; U) X C^jm+; D) with ||xio||., + ||x2o||r2 +sup,>o \u{t)\ < S,+i. 
Since i5,+i < 5, , from the assumption it follows that the fact holds for the nonnega- 
tive integer / : 

sup{ II Tr, (t)xi l.^ + II r,2(f)x2||,.,; t e [to, to + Tf+i - T]} < e (1.89) 

Moreover, since 5/+i(e, T) < ^((^^(e, TJ+i), T), it follows from the assumption 
that the fact holds for the nonnegative integer / : 

||7>i(fo + Ti+x - T)xi l.^ + JTr^ito + Ti+i - T)x2l^ < -l{e, Ti+i) (1.90) 

Furthermore, since ||xio||,-i + lk2olla + sup,>o|M(f)| < 5;+i and (5,+i(e, T) < 
^^(e, Ti+i), we obtain that sup,>Q \u(t)\ < ^S(s, Ij+i). Combining (1.90) and the 
previous inequality, we get 

\\Tri(to + Ti+i -r)xi|| + JTr^ito + Ti+i -r)x2|| +sup|M(f)| <S(s,Ti+i) 

t>0 

(1-91) 

Notice that since to e [0, T], we obtain that to + r,+i — T e[Q, Ti+i]. The solution 
XI e CO([ro - ri, fmax); »i"'), X2 e £~ ([fo - ^2, Wx); 9f' 2) of (1.18), (1.19) with 
7>i(fo)xi = xio, Tr2(to)x2 — X20 corresponding to inputs (u,d) e £j^^, (!){+; U) x 
C'^^.(M+;D) with ||xio||r, + ||x2o||r2 + sup,>olM(OI < ^/+i coincides, over the 
time interval [to + T/+i — T, 00), with the solution xi e C'^([to + Ti+i — 7 — 
n, rmax); At"'), ^2 e /:~ ([fo + 7^+i -T-r2, Wx); at"^) of (1.18), (1.19) with ini- 
tial condition (T";., (to + Ti+i — T)xi, T^^ito + 7)+! — r)x2) corresponding to same 
inputs (m, d) e C'^^(9i+; U) x C'^^('in+; D) satisfying (1.91). Using Lemma 1.1, in 
conjunction with(l. 91), definition(l. 87), and the fact that fo + Tz+i — T e [0, T;+i], 
we obtain 

sup{ II r„ (0x1 1^^ + II r„(0x2||,.^; te[to + Ti+i -T,to + Ti+2 -T]}<s (1.92) 

Combining (1.89) with (1.92), we may conclude that the fact holds for / + 1. 

By virtue of the fact, it follows that Theorem 1.3 holds with S(£, T,h) :— 
^l(T,h) (£' T) > 0, where l(T, h) is the nonnegative integer with the property that the 
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sequence {7/}^o defined by (1.87) with initial condition Tq — T satisfies T, >T + h 
for all / > 1{T, h). The proof is complete. D 

Example 1.4.4 (Robust equilibrium points for control systems described by FDEs) 
Theorem 1 .2 shows that e A" is a robust equilibrium point from the input u e My 
for system (1.42) under Hypotheses (Ql-3). 

Example 1.4.5 (Robust equilibrium points for control systems with variable sam- 
pling partition) The following proposition guarantees that system (1.57) under Hy- 
potheses (Al-5) has a robust equilibrium point from the input u e My. 

Proposition 1.2 e 9{" is a robust equilibrium point from the input u e Mu for 
system (1.57) under Hypotheses (Al-5). 

Proo/ Since f {t,r, 0,0,0, Q,d, do) =0 and R{r,0,0,0,0,d,do) =0 for all 
ir,d,do) edi+ X D X D and t >r, and //(r,0,0) = for all r > 0, it fol- 
lows that property (1) of Definition 1.5 is automatically satisfied. It suffices to 
show that for all e > and T, T' e ili"*", there exists S :— S{s, T, T') > such 
that for all {to,xo,u,d) e [0, T] x M" x Mu x Md and t e [fo, fo + T'] with 
|xo| + sup,>Q \u(t)\ < 8, it holds that the solution x(t) of (1.57) with initial con- 
dition x(tQ) — XQ corresponding to inputs {u,d) e My x Mo exists and satisfies 
sup{|x(f)|; deMD,te [to, to + T'], to e [0, T]} < s. 

Claim 1 For all e > and T > 0, there exists & :— S{s, T) > such that if\x(to)\ + 
sup,>o \u(t)\ < S, then the unique solution o/(1.57) starting from x{tQ) at time to e 
[0, r] and corresponding to inputs {u,d) € Mj/ x Md exists for all t e [to, ri] and 
satisfies \x(t)\ < s for all t e [fo. ''^iIj where ti = fo + h{to,x(to), u(to), d(to)). 

Proof of Claim 1 Let L > be the constant that satisfies (1.58) for the bounded set 
S := [0, T +r]x[0,T + r]x B[0, s] x B[0, s] x Bu [0, s] x Bu [0, s]. It follows 
from (1.58), (1.59) that the following inequality holds for all x, xq e B[0, s], u, mq £ 
Bu [0, s], r e [0, T], t e [r, r + r], and d, do e D: 

2x' Pf{t, X, X, xo, u, mq, d, do) 

< (2L + K2)\x\^ + MK2a^{\xQ\ + \u\ + \uo\) (1.93) 

where M :— max[y^(t); t e [0,T + r]}, Ki, K2 > are constants that satisfy 
A'llxp < x'Px < K2\x\^ for all x e SB" for the symmetric positive definite matrix 
P e ;)^"><" involved in Hypothesis (Al), and y e K~^ and a e Koc are the functions 
involved in (1.59), (1.60). Let p > be the unique solution of the equation 

e^^l^expj'^^^^i^Vp^ + rMfl^Op)) (1.94) 

where r > is the upper bound for h, and 

£1 :=min|-,-fl-M |1>0 (1-95) 

I2 4 \max{y(t);te[0,T+r]}J\ 
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Define 

Y^pj (1-96) 

For arbitrary (x(fo), u,d) e di" x My x Md with |x(fo)| + sup,>o \u(t)\ < S, con- 
sider the unique solution x(t) e M" of (1.57) starting from x(ro) and correspond- 
ing to input (u,d) e Mjj x Md- Since (1.96) implies 8 < si, it follows that 
|x(fo)| < £1. Next, we show that \x(t)\ < si for all t e [to, zi). The proof will 
be made by contradiction. Suppose that there exists fi e (fo.^i) with |x(fi)| > 
£1. Let ?g the maximal time in the interval [ro,fi] such that \x(t)\ < s\ for all 
t e [to,ti;). By virtue of continuity of the solution with respect to time on the 
interval [to, ti), the maximal time tg is well defined. By continuity of the solu- 
tion with respect to time we must have |x(fg)| = £i. On the other hand, inequal- 
ity (1.93), in conjunction with the fact |x(fo)| + sup,>o !«(?)! < S and definition 
(1.96), implies that the absolutely continuous function V(t) = x'{t)Px{t) satis- 
fies V(t) < (21 + K2)\x(t)\^ + K2Ma^(3p) for almost all t e [to, t^]. Using the 
previous differential inequality and inequality A'llxp < x'Px < ^"21-^1^^ we ob- 
tain \x(t)\^ < If |x(ro)P + ^^ f,[ \x(s)\^ds + r^MaH3p) for all t e [to, ?.]. 
The previous inequality, in conjunction with the Gronwall-Bellman lemma, im- 
plies \x(t)\^ < exp(^?^^±p^)|^(|jt;(fo)|2 + rMfl2(3p)) for all t e [to, tg]. Again, 
the previous inequality, in conjunction with (1.94), the fact that tg < ti < to + r, 
and inequality |x(ro)| < p, directly implies that |x(?e)| < y < £i, which contradicts 
|x(f£)| — E\. We conclude that |x(f)| < £i for all t e [to, x\). 

By virtue of uniform continuity of the solution on the interval [to, x\) (notice that 
by (1.59) x(t) is bounded on [to, ti)), it follows that the limit lim^^j.- x{t) exists 
and satisfies llim^^^- x(f)| < £i. Using (1.60) in conjunction with (1.95), (1.96), 
the facts that to <x\<to + r, |x(fo)| + sup,>Q \u(t)\ < S, and | lim,^^- x(t)\ < si, 
we conclude that |x(ti)| < £. The previous inequality, combined with the facts that 
£i < £ and |x(OI < £i for all t e [to, ti), implies that |x(f)| < £ for all t e [to, ti]. 
Consequently, Claim 1 is proved. D 

Using induction, the fact that r, < to + ir for all nonnegative integers i (where 
r > is the upper bound for h) and Claim 1, we may conclude that the following 
claim holds. 

Claim 2 For all s > 0, T > 0, and integers N > 0, there exists S := S{s, T, N) > 
such that if |x(fo)| + sup,>Q \u{t)\ < S, then the unique solution o/(1.57) starting 
from x(to) at time ?o G [0, T] and corresponding to inputs (u,d) e My x Md exists 
for all t e [to, T^r] and satisfies \x{t)\ < e for all t e [?o, xn], where t/+i = r,- + 
/z(t;,x(t,), uiji), d(ri)), i = I, . . . , N — I, with tq = to- 
Next, consider the continuous function hi involved in Hypothesis (A5). For this 
function, we have the following claim. 

Claim 3 For all e > and T > 0, there exists an integer N :— N{s, T) > such 
that tn > T, where s :— vmn{hi{t, x,u); (t,x,u) e [0,7"] x 5[0, £] x B(/[0, £]}, 
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and the sequence {r,}v_„ satisfies r/_|_i > min{gfe(r,), Xi -\- s}, i — \, . . . , N — 1, 
with arbitrary initial condition tq > 0, where qtit) '■— minjr & b; t < T}, and 
b — {7/}^Q is the partition involved in Hypothesis (A5). 

Proof of Claim 3 Let arbitrary e > 0, T > 0. Since the set [0, T] x B[0, s] x 
B(/[0, e] is compact {U C W^ is closed) and hi is continuous, we have s > Q. 
Consider the infinite sequence {y/l^Q which satisfies y,-|_i = mm{qh{yi), yi + s}, 
i — 1,2, ..., with }'o — 0. Using a contradiction argument, we can show that 
yi -^ +CXD, and consequently for every 7 > 0, there exists an integer N > such 
that yN > T. Consider arbitrary tq > and an arbitrary sequence {TjI^q that satis- 
fies r/+i > min{qb{ri), Xj +s},i — \, . . . ,N — \. By virtue of Theorem 1.6.1 in [33] 
(Comparison principle), we have Xi>yi,i — \,...,N, which implies Xf^ > T. The 
proof of Claim 3 is complete. D 

We are now ready to show the required property. Consider arbitrary e > 0, 
T, T' e i)J+. Claim 3 implies that there exists an integer A^ :— N{s, T + T' + r) > 
such that xn > T + T' + r, where s := min{h] (t , x , u); (t,x, u) e [0, T + T' + r] x 
B[0, e] X 5(/[0, e]}, and the sequence {t,}^Q satisfies t;+i > mm{qi,{xi), r,- + s], 
i — I, . . . , N — 1, with arbitrary initial condition tq > 0. On the other hand, by virtue 
of Claim 2, there exists S := S(s, T, N) > such that if |x(ro)| + sup,>o \u(t)\ < S, 
then the unique solution of (1.57) starting from x{to) at time fo e [0, T] and corre- 
sponding to inputs {u,d) e Mu x Md exists for all t e [to, x^] and satisfies \x{t) \ < 
£ for all t e [to, Xfj], where r,_|_i = t; -|- h{xi,x{Xi), u{xi), d(Xj)), i — I, . . . , N — 1, 
with To — to. Hypothesis (A5) implies that the sequence {xi}f_Q satisfies the in- 
equality r,-|-i > rmn{qh(xi), r,- + s] for all integers / for which Xj < T + T' + r. 
If we assume that x^ < T + T', then we obtain a contradiction, and thus we con- 
clude that Xfi > T + T'. It follows that if \x(to) \ + sup,>Q \u(t) \ < S, then the unique 
solution of (1.57) starting from x{to) at time to e [0, T] and corresponding to in- 
puts (u,d) e Mu X Md exists for all t e[to,tQ + T'] and satisfies \x(t)\ < e for all 
t e [to, to + T'l D 

Since our interest is focused on sampled-data systems of the form (1.62) or (1.63) 
(with no impulses), we can use the following result. 

Proposition 1.3 Consider system (1.57) under Hypotheses (Al-4) and suppose that 
R{t, X, xo, u, uo, d, do) — X for all (t, u, mq, d, do, x, xo) e [ft"*" xUxUxDxDx 
Dt" X Dt" . Then e 9{" is a robust equilibrium point from the input u € Mu for 
system (1.57). 

Proof Let s >0,T,T' e M+, and let L > be the constant that satisfies (1.58) for 
the bounded set S := [0, T + T'] x [0, T + T'] x B[0, s] x B[0, e] x Bu[0, s] x 
Z?(/[0, e]. Let p > be the unique solution of the equation 



exp( ^'^ + ^'^l'' + ^'^ ){p' + (r + T')MaH3p)) (1.97) 



2 4K2 ({2L + Ki){T + T') 

^1 
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where r > is the upper bound for h, and define 



S — min 



(1.98) 



The proof will be made by contradiction. Suppose that there exists (jcq, m) e M" x 
My with |jco| + sup,>o \u(t)\ < 8 and 

sup{|(/)(T,ro,-«o,M,<^)|;<^ e MD,r e [tQ,to + T'],tQ e[0,T]] > s 

Consequently, there exist d e Md, to e [0, T], and t e [to, to + T'] with \x{t)\ > ^ 
(where x(t) = (p{t, to, xo, u, d)). Consider the nonempty set A — [t >to'. \x(t)\ > 
y } and let ti — MA. Notice that since \xo\ < ^ < § and |jc(f)| > ^, it follows that 
fi > to and ti <to + T'. Furthermore, by the definition fi — inf A and the continuity 
ofx(f) (this holds only for the impulse-free case), we have |.x(fi)| = ^ and \x(t)\ < 
s for all t e [?o, fi]- In this case, we consider the absolutely continuous function 
V(t) = x'{t)Px{t), which by (1.93) satisfies the following inequality a.e. for t e 
[toJiV- 

Vit) < (2L + K2)\x(t)\^ + K2Ma^(3p) (1.99) 

Using (1.99) and the inequality Kilx]"^ < x'Px < KjIx]-, we obtain \x(t)\'^ < 
ftk(fo)P + ^^fr[ \xis)\^ds + (T + nffMfl2(3p) for all t e [fo,fi]. The 
previous inequality, in conjunction with the Gronwall-Bellman lemma, implies 

, ,2 /(2L + K2){T + T')\K2n ,2 / ,N 9 X 

|x(0| < exp P ^ ^^'^ ^ j _^(|^(fo)|2 + (7^ + r')M«2(3p)) 

Wte[to,ti] 
The previous inequality, together with (1.97) and the inequality |x(fo)| < p, directly 



implies that |x(ri)| < |, which contradicts |x(fi)| 



5e 



The proof is complete. D 



1.5 Feedback Interconnection of Systems 

We next give the notion of the interconnection or feedback connection of control 
systems. See Fig. 1 .2 for an illustration. 

Definition 1.6 Consider a pair of control systems 

Ei^{Xi,YuMs,xu,MD,4>i,yti,Hi) 

^2 = (^23^2, Ms, xf/, Md,4>2, Tt2, H2) 



Fig. 1.2 Configuration of 
interconnected systems 
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with outputs Hi : m+ x Xi x y2 x U ^ Si ^ yi, H2 : 9t+ x Xj x Ji x U ^ 
Si '^yi, and the BIC property and for which Q e Xi, i — \,2, are robust equilib- 
rium points from the inputs {V2,u) e Ms^xU and {vi,u) e Ms^xU^ respectively. 
Suppose that there exists a unique mapping (p — (cpi, (pj) : A^ —^ X and a set- 
valued map iK"*" X X X Mjj x Mo 3 {tQ,xo,u,d) — >- jT{to,xo,u,d) C [to, +00), 
where A^ C ;){+ x !){+ x X x Mu x Mb and X — Xi x X2, such that, for ev- 
ery {t,to,xo,u,d) e A^ with t > to and xq — (xifi,x2fi) e Xi x X2, it holds 
that there exists a pair of external inputs V/ c /A(Si), i — 1,2, with di(t) — 
Hi(r, 01 (r, to,xo,u,d), ii2(t), m(t)), V2(t) — H2(r, (/)2(t, fo^-^^o, «, <^)> i'i(t), m(t)) 
for all T e [to,t], (vi,u) e MsjxU^ i = 1>2, so that Tt{to,xo,u,d) — TTi(to,xifi, 
(V2, u), d)n7T2{to,X2,o, (v\, u), d) and 01 (t, to,xo,u,d) = 0i(t, fo>-^i,o, (V2,u),d), 
02(t, to, xo, u, d) — 02(7, to, X2fi, {vi, u), d) for all t e [fo, f]- 

Moreover, let 3^ be a normed linear space, and H : i){+ x X x U ^^ y & con- 
tinuous map that maps bounded sets of Di"*" x X x U into bounded sets of y with 
H(t, 0, 0) = for all f > and suppose that E := {X, y, Mu, Md, </>, tt, H) is a 
control system with outputs and the BIC property, for which e A:" is a robust equi- 
librium point from the input u e Mu . Then, system E is said to be the feedback 
connection or the interconnection of systems Ei and ^2- 

It should be emphasized that the feedback interconnection of two systems may 
create a system which has different qualitative properties from each one of the sys- 
tems connected. For example, if we connect a control system described by RPDEs 
with a control system with impulses at fixed times, then the overall system will be 
a system with both "memory" and impulses (discontinuous systems described by 
RFDEs; see [49]). 

The feedback interconnection of two systems is not always well defined. For 
example, the uniqueness of the map (f> — (cpi, ^2) '■ A^ —> Xi x X2 requires regular- 
ity properties which must be satisfied. The nature of the additional properties that 
guarantee that the feedback interconnection of two systems is well defined depends 
heavily on the nature of the overall system. The following example illustrates this 
point. 

Example 1.5.1 Consider the following feedback interconnection of two systems de- 
scribed by ODEs: 

X — f(t, d, X, u) 
V — p(t, X, u) 
;c e 9t", M e [/ c 9r, J e Z) c !){' (1.100) 

and 

w — g{t,w,v) 
u — k{t, w, v) 



w 



e9r,i;ey cat? (1.101) 
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where systems (1.100) and (1.101) satisfy Hypotheses (Hl^). In order the feed- 
back interconnection of systems (1.1 00), ( 1 . 1 1 ) to be well defined, we must require 
that for any given (t, x, w), there exists a unique pair of solutions u = k*(t, x, w), 
V — p*{t,x, w) to the algebraic equations v = p{t,x, u) and u — k{t, w, v). For 
example, this requirement is not fulfilled if k(t, w, v) :— v e !)i and p(t,x, u) — 
2m — M^ with u e !)i If for any given (t,x, w), there exists a unique pair of so- 
lutions u — k*(t, X, w), V — p*(t, X, w) to the algebraic equations v — p(t, x, u), 
u — k{t, w, v) and if all maps (/, g, p* , k*) are assumed to be locally Lipschitz, 
then the total interconnected system takes the following form: 

X — f{t, d, X, k*(t, X, w)) 

w — g[t, w, p*(t, X, w)) 

X e 9t", w e i)t*, deD^ m' (1.102) 

Indeed, if all maps (/, g, p*,k*) are assumed to be locally Lipschitz, then Hypothe- 
ses (Hl-4) automatically hold for system (1.102), and the feedback interconnection 
of systems ( 1 . 1 00), ( 1 . 1 1 ) is well defined. 
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Definition 1.7 Let A" be a normed linear space. We say that a map : D{+ xX —^ X 
with 0(t, 0) = for all r > is a change of coordinates if: 

(i) 0(f,A') = A'forallf >0; 
(ii) For every t >0, the following implication holds: 

0(r,xi) = 0(f,x2) ^ Jci=x2; (1.103) 

(iii) there exist a continuous map (called the inverse map) 0~^ : !){+ x X ^^ X and 
functions a e Kqc, P e K~^ such that 

x^0{t,(p-^(t,x))=(p-^{t,0(t,x)) forall(r,x)e;){+ X A:" (1.104) 
\\0(t,x)\\^<a{p(t)\\x\\x) and \\0-\t,x)\\^ <a{pit)\\x\\x) 
forall(f,x)eS){+ X A". (1.105) 

Definition 1.8 Let U, V be subsets of the normed linear spaces UiMi, respectively, 
with e U and e V. A continuous mapping q : di~^ x V —> U with q(t, V) — U 
and q(t,0) =0 for all f > for which there exist functions a e Koa and /i e K^ 
such that \\q(t, v)\\ui < ci(l^(t)\\v\\u2) i^ called a transformation of V onto U. 

The following lemma can be verified easily by the reader. 

Lemma 1.2 Consider a deterministic control system E :— {X ,y, Mu , Md, 
4>,7t, H) with outputs satisfying the BIC property. Let : fli"*" x X ^ X be a 
change of coordinates, and q : iW''" x V — >• [/ a transformation of V onto U . Then 
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E' :— (X , y. My, Md, (f)' , Tc' , H') is a deterministic control system satisfying the 
BIC property, where My is the set of all mappings v : iJt"*" -> V with the prop- 
erty that the mapping Qv : ^X^ — >• U defined by {Qv){t) — q{t, v(t)) for all t >0 
satisfies Qv e Mu and (f>' , it' , H' are defined by the following equations: 

(p'(t,to,xo,v,d) = 0{t,^{t,to,(P~^ito,XQ), Qv,d)) (1.106) 

7t'ito,xo, v,d) — 7r(fo, 0~\to,xo), Qv,d) (1.107) 

H'(t,x, v) := H{t, <P~\t,x),q{t, v)) (1.108) 

Moreover, if Q & X is a robust equilibrium point from the input u e Mu for S, then 
& X is a robust equilibrium point from the input v e My for S' . 

The system U' := (X, y, Mu, Md,<P', H') provided by Lemma 1.2 is called the 
transformed system E under the change of coordinates : X ^>- X and the input 
transformation q : i)}"*" x V — ^ f/. Notice that if the weak semigroup property holds 
for E, then the weak semigroup property holds for E' . 

Lemma 1.2 will help in the study of a given system, since very often it is possible 
to find a change of coordinates : X ^^ X and an input transformation q : Ot"*" x 
V —^ U such that the study of the transformed system E' is easier than the study 
of the original system E . Moreover, transformations of systems help us to study 
systems which do not necessarily fall into one of the categories of systems studied 
in Sect. 1.2. The following example illustrates the effect of the transformation for 
systems described by ODEs. 

Example 1.6.1 Consider system (1.3) under Hypotheses (Hl^). Let : iW"*" x 
9t" — >• 9{" be a change of coordinates, and q : i)t"'" x V ^ U a transformation of 
y c at' onto U c di"' . Moreover, suppose that : D{+ x !){" -^ Dt" is continuously 
differentiable. Then, the transformed system E' := (St" , Di* , M\/ , Mq , </>', //') un- 
der the change of coordinates : iH+ x ;){" — > Dt" and the input transformation 
q : St"*" x y — > C/ is a control system described by the following equations: 

x(t)^—{t,0-^{t,x{t))) 

+ ^it,0-'it,x{t)))f{t,0-'{t,x(t)),q{t,v(t)),d(t)) 

Y(t) = H{t, 0~^ {t, x(t)),q{t, v(t))) 

x(t) e 9{", F(r) e 9{^ D(f) e V, d{t) e D (1.109) 

Notice that Hypotheses (Hl^) are not necessarily satisfied for system (1.109). 
However, Lemma 1.2 guarantees that the system E' :— (!){", i)t*^. My, Md,^', H') 
is a deterministic control system which satisfies both the classical semigroup prop- 
erty and the BIC property. Moreover, e W is a robust equilibrium point from the 
input II e My for E' . Finally, notice that although Hypothesis (HI) is not necessar- 
ily satisfied for (1.109), if 0~^ : D{+ x Ot" — ^ 9{" is continuously differentiable, we 
can guarantee that the initial value problem for (1.109) has a unique solution for all 
{v,d) e My X Md- 
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1.7 Discrete-Time Systems 

Let X, y,U be a triplet of normed linear spaces, D, U C.U nonempty sets with 
e U, JT — {t,}^q a partition of i)i+ with diameter r > 0, i.e., an increasing se- 
quence of times with tq = 0, sup{T/_|_i — t,; / = 0, 1, 2, . . .} = r and r,- —^ +oo, and 
f:7TxDxXxU^X,H:m+xXxU^y mappings with f(t, d, 0, 0) = 
and H{t, 0, 0) = for all (t, d) eir x D.Ws define p„ (t) — maxfr e jr : r < t} 
and q„{t) = min{T en : x > t}. We consider the system that produces for each 
(fo, xq) e !H+ X X and for each pair of piecewise constant, right-continuous map- 
pings u : i)}"*" -^ U and d : !){+ -^ D which are continuous on D{+\7T, the piecewise 
constant function t ^ x(t) e X, based on the following algorithm: 

StepO: Setx(r)=xo,forallf e [to,q„(to)) and x(q„(to)) ^ f(p„(to),d(p„(to)), 
xo,u{p„{to))). 
Step i: Given r,- e it and x(r,), set x(f) — x(t/) for all t e [r,-, r,-|_i) and x(r,_|_i) = 

/(T;,J(r,),x(T;),M(T,)). 

Schematically, we write 

x(f)=x(T;) f e[T,-,T, + i) 

■^ (t,+i ) = / {ri ,d{xi),x (ti ) , M (t/ )) (1.110) 

Y(t)^H{t,x{t),u(t)) 

with initial condition x(to) — xq e X. We consider systems of the form (1.110) 
under the following hypotheses: 

(LI) There exist functions a e K^o and fi e K^ such that \\f{t,d,x,u)\\x < 
a(fiit)\\x\\x) + a(P{t)\\u\\u) for all (t,x,d,u) en x X x D xU . 

(L2) For all {xi , x , u) e n x X x U and t e [r,-, r,_|_i), it holds that Hit, x, u) — 
H {Xj , X , u) . Moreover, for each fixed r, en, the mapping X x U 3 (x,u) ^■ 
H{xi ,x,u) is uniformly continuous on each bounded setin X x U. 

(L3) For every pair of bounded sets I Cn, S C X xU, the set H{I x S) is bounded. 

Let Md be the set of piecewise constant, right-continuous mappings d : 9i"'" —>■ D 
that are continuous on !)t"'"\7r (i.e., mappings d : Di"*" -^ D for which there exists 
a sequence {di e D}?Zq such that for every t,- e n, it holds that d{t) — d, for all 
t e [xj, r,-|_i)). Similarly, let Mu be the set of piecewise constant, right-continuous 
mappings u : Di+ -^ U that are continuous on ;){+\7r. 

Systems of the form (1.110) are called discrete-time systems and have been stud- 
ied extensively in the literature for the case n — Z"*". We next provide an example 
of an economic system that can be modeled by means of a discrete-time system. 

Example 1.7.1 (The Cobweb model with stocks) We consider the evolution of the 
price of a certain commodity in a completely competitive market at discrete periods: 
each period f + 1 is characterized by the release in the market of 5(f -|- 1) units of the 
commodity, which are supplied by certain agents and by the release G{t) units of the 
commodity by the government. Let us denote by P(t) the price of the commodity 
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at period t, and by Q{t) the quantity of the commodity stored by the government 
at period t. When G{t) < 0, then the government actually buys and stores \G{t)\ 
commodity units at period r + 1. Let Qmax > denote the storage capability for 
the particular commodity. Consequently, the following intrinsic constraints must be 
satisfied for all periods: 

G{t)<Q{t) and < 0(0 < gmax for all f (1.111) 

Furthermore, the quantity of the commodity stored by the government must obey 
the following difference equation for all periods: 

Q(t+\)^Q{t)-G{t) (1.112) 

Since the quantity of the commodity stored by the government at period f + 1 cannot 
exceed (2max > (the storage capability), i.e., Q{t + \) < Qma\, it follows from 
(1.112) that the following constraint for the quantity of the commodity released to 
the market by the government at period f + 1 must be obeyed: 

2(0 - emax < G(f) for all r (1.113) 

We assume a linear strictly decreasing demand function 

D{t)^a-bP{t) a,b>0 (1.114) 

and an ^-shaped monotonic piecewise linear supply function: 

S{t + l)^g{PHt + l)) (1.115) 

g(/') = max{0;min{5'max;-c + rfP}} c,d,S^^^>0 (1.116) 

where P^(t + 1) is the expected price for the period t + I, and Smax is the highest 
supply level for the commodity. The total quantity of the product available in the 
market at period r + 1 is given by S{t + 1) + G(t), and therefore the following 
constraint must be obeyed in addition to the previous constraints: 

G{t)>-g{P'it + l)) for all r (1.117) 

In a completely competitive market, market equilibrium is attained instantaneously: 

£)(f + l) = 5(f + 1) + G(r) (1.118) 

Finally, we assume the so-called naive (or myopic) expectation, 

P'(t + l)^P(t) (1.119) 

which is met frequently in textbooks. 

Taking into account (1.111)-(1.119), the unique solution of (1.118) gives the 
following discrete-time control system: 

P(t+l)^b-'{a-G{t)-g{P(t))) 

Q(t + l) = Q(t)-G(t) (1.120) 

max{e(r) - g^ax; -g(^(0)} < G(t) < Q(t) 
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We assume that a > (2max + 5'max and be < ad (conditions for the viability of the 
conunodity). It is convenient to introduce the dimensionless variables 

xi(t):^ba-^P(t- 1)-Xeq X2(t) = a'^ Q(t) 

G(f) =niin{e(f);max{aM(f); Q{t) - Qn,^; -max{0;mm{Sn,^;dP(t) - c}}}} 

(1.121) 

and the dimensionless constants r := db~^ > 0, ci :— ^ < 1, c? := ''y < ^, 

' ^ ad ' ^ ad (3 ' 

C3 =a"'gmax,and 



xeq= + (1.122) 

[l -C2r if ci + C2 < 1 - C2r 

Thus the control system (1.120) expressed in state space form and in dimensionless 
coordinates is given by the following discrete-time control system: 

xi(f + l) = /i(xi(r)) -/2(xi(r),x2(0,M(0) 

X2it + 1) = L(x2(0) - /2(xi(0, X2(t), m(0) 

x(t) = (xi(0, X2(r)) e ;){^ m(0 e 9^ (1.123) 



where 



/i(x) 

f2{x,y,u) 

P(x) 

L{y) 



— 1 — Xeq — r maxjO; min(c2; P(x +Xeq) — ci)} 
= min{L(y); maxJM; L{y) -C3; /i(x) -l-Xeq- l}} 

— maxjO; min(l; x)} 

— maxjO; min(c3; y)] 



Notice that /i(0) = /2(0, 0, 0) = 0. Define X = df, y = M, and the output map 
H(t, X, u) := XI. Hypotheses (LI), (L2), (L3) thus hold for system (1.123). 

We denote by (pit, to, xq, u, d) :— x(t) the solution of (1.110) with initial con- 
dition x(fo) — Xq & X, corresponding to inputs {u,d) e My x Mq. It should 
be clear that, by the previous definitions, we have defined the system E :— 
{X, y, Mu, MD,(p,7t, H) with A^ C i){+ x !)t+ x A" x Mu x Md given by the 
set of points (t, to, xq, u, d) e Dt"*" x D{+ x A:" x Mu x Mo, where t e [ro, +00) and 
7t{tQ,XQ,u,d) — [fo, +00) (notice that the classical semigroup property holds). 

Notice that if fit + T, d, x, u) — fit, d, x, u). Hit + T, x, u) — Hit, x, u) and 
7T — {( y }^o for certain T > and certain integer / > and for all it,d,u,x) e 
jt X D X U X X, then system (1.110) is T-periodic. 

It is worth noting the following important fact for system (1.110): 

Lemma 1.3 System (1.110) under Hypothesis (LI) is Robustly Forward Complete 
(RFC) from the input u e My . 
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Concerning the proof of Lemma 1.3, we consider arbitrary R >0, T e St"*" and 
then define recursively the sequence of sets in X by A{k) :— A{k — 1) U /((tt n 
[0, 2T]) X Dx A{k-l)x Bu[0, R]) for A: = 1, . . . , /, where / e Z+ satisfies r/ = 
Pn{2T), Bu[0, R] := {u e U; \\u\\u < R}, and A(0) := {x e X; \\x\\x < R}, which 
are bounded (by virtue of Hypothesis (LI)), and finally notice that 

{(l>it + s,to,xo,u,d); \\xo\\x <R,toe [0,T],s e [0,T],d eMo, 
u e M{Bu[0, R]) n Mf/} c A(l) 
We end this section by showing the following fact. 

Lemma 1.4 e X is a robust equilibrium point from the input u e My for sys- 
tem (1.110) under Hypothesis (LI). 

The proof of Lemma 1 .4 relies on the following result. 

Lemma 1.5 Consider system (1.110) under Hypothesis (LI). For all i, N e Z"*" and 
£ > 0, there exists S(i, N, s) > such that the following implication holds: 

||x(r,-)||^ + sup||m(?)||7/ <&{i, N, £) 

?>0 

^ sup{\\x{ri+s)\\.^:deMD,s e{0,...,N}} <s (1.124) 

Proof We prove the Lemma 1.5 by induction on N e Z+. Notice that implication 
(1.124) holds for A^ = (select S(i, 0,£) — s > 0). Next, suppose that implication 
(1.124) holds for certain N eZ+. Define 

8(i,N,s),S[i,N, «"M - 1 ll (1-125) 



S{i,N + l,e) :=min 



where a e Kqo and fi e K^ are the functions involved in Hypothesis (LI). By defi- 
nition (1.125) and implication (1.124) it follows that 



|x(r,-)||^ + sup||M(r)||^ <&{i,N -\-l,s) 

t>0 



Viri+N)\\x<l7r^ -.a~'\^] (1.127) 



=► sup{||x(T,+.5)||^ :cf eMD,5 e {0,...,Af}} <e (1.126) 

||x(r,-)|| V + sup||M(r)||^ <&{i,N + l,E) 

1 

^(t,+/v) 

Inequality (1.127), in conjunction with Hypothesis (LI) and the fact that 
\\u(ri+N)\\u < ^(^/^^) a~H§) (which holds if [[^(t,)!!;^ + supj>o IIm(OIIw < 
S(i, N + I, e); see definition (1.125), implies that 

Ik (^'^ II A" +^^P||''(^)||7y S^ii^N + l,s) 

t>0 

=^ sup{\\x(ri+N+i)\\pf: -d eMo} <s (1.128) 
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Combining (1.126) and (1.128), we conclude that implication (1.124) holds for 
N + I. The proof is complete. D 

We are now ready to prove Lemma 1.4. 

Proof of Lemma 1.4 It suffices to show that for all £ > 0, A'^ e Z+, and / e Z+ with 
N >l, there exists 8 :— S(s, N, I) e (0, e] such that 

\\xo\\x + sup||M(r)|L <S, toe {to, . . . , t;} 

f>0 

^ sup{||(/>(T/, tQ,XQ,u,d)\\-^;ri e jt n [fo, rN],d e Md} < £ 

The above implication holds with 8 := S{s,N,l) — min,=o,...,/ 15(/, A/^, e), where 
8{i, N,s) > is provided by Lemma 1.5. The proof is complete. D 



1.8 Bibliographical and Historical Notes 

( 1 ) Abstract definitions of control systems with outputs were presented in [2 1 , 46] . 
A definition similar in spirit to the definitions given in [21, 46] was later pre- 
sented in [22]. A qualitatively different definition of a control system (which 
is adopted in the present text) was given in [26, 27]. The difference between 
Definition 1.1 of a control system with outputs and Definition 2. 1 in [22] lies 
in property 4 (semigroup property). In the above definition we do not require 
7T{to, XQ, u,d) — [to, ?max) (in contrast with Definition 2.1 in [22]). This modi- 
fication allows us to study important classes of systems, which were excluded 
by Definition 2.1 in [22]. 

(2) It should be emphasized that there are systems that do not satisfy the weak 
semigroup property (e.g., systems described by integrodifferential equations 
studied in [32], such as x{t) — —x{t) + /^ sin(fjc(i')) ds, x{t) e ?i\ with initial 
condition xito) — xq e J){). 

(3) Initial-value problems of the form (1.18), (1.19), (1.20) arise in electrical, ther- 
mal, and hydraulic engineering (see, for instance, the model of combined heat 
and electricity generation and other models reported in [35, 42] concerning 
lossless transmission lines with electrical circuits and turbines under water- 
hammer conditions). 

(4) Other concepts of weak solutions for linear neutral functional differential 
equations were given in [5, 17]. In recent works control-theoretic aspects for 
linear neutral functional differential equations are studied (see [15, 16]). 

(5) It should be noticed that recent contributions in the literature study systems of 
coupled RFDEs and FDEs of the form (1.18), (1.19), (1.20) per se (see, for 
instance, [35, 38, 39] and references therein). The difference between [35, 38, 
39] and the recent work in [31] is that the matching condition is not assumed 
to hold in [31]. This is the viewpoint adopted in the present work. 
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(6) Sampled-data feedback (1.62) has been considered in [7, 13, 25, 34, 44, 47]. 
Particularly, Theorem 9.3.1 in [13] provides links to the classical results in 
[7, 47]. Moreover, control systems under a hybrid feedback law with asyn- 
chronous switching rules (as given in [43]) can be modeled as systems of the 
form (1.57). 

(7) Notice that there is a difference between Definition 1.6 and Definition 7.2.3 
in [46] : we do not exclude interconnections of control systems that may have 
finite escape time. Moreover, we can allow 1^2 — ('^2, Y2, Ms^ xC/, Md, 4>2, 
^2, H2) to be just a continuous map from 91+ x 3^i into 3^2 (a static map — this 
is allowed as well by Definition 7.2.3 in [46]). Of course, usually the continuity 
of a static map is not enough to guarantee that there is an interconnection 
of two subsystems. More specifically, in order to guarantee the uniqueness 
of the map — ((/>i, (p2) : A^ ^ Xi x X2, other regularity properties must 
be satisfied as well depending on the nature of the overall system. The well- 
posedness of the interconnection of two finite-dimensional systems described 
by ordinary differential equations is addressed in [20]; see also [9] for the 
description of feedback systems using input-output approaches. 

(8) Discrete-time systems on normed linear spaces were studied in [23, 24]. 
Discrete-time systems with disturbances were studied in [18, 19]. 

(9) The chemostat model (1.4) with variable yield coefficients has been studied 
recently (see [50, 51]) and has been proposed for the justification of experi- 
mental results. The delayed chemostat model (1.11) has been studied in [29]. 

(10) The uncertain dynamic model for the Cournot oligopoly game (1.53) was stud- 
ied in [28]. See also [1, 4, 6, 10, 12, 36, 37] for other studies for the dynamic 
Cournot oligopoly game. 

(11) The discrete-time model (1.123) for the cobweb model with stocks was pro- 
posed in [2]. 

(12) The study of numerical schemes for ordinary differential equations by means 
of hybrid systems was proposed recently in [26, 30]. Usually, numerical 
schemes for ordinary differential equations were studied by means of discrete- 
time systems (see, for instance, [33, 48]). 
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Chapter 2 

Internal Stability: 

Notions and Characterizations 



2.1 Introduction 

This chapter is devoted to the analysis of internal global stability notions used in 
mathematical control and systems theory. The stability notions presented are devel- 
oped in the system-theoretic framework described in the previous chapter so that 
one can obtain a wide perspective of the role of stability in various classes of deter- 
ministic systems. 

The stability notions developed in this chapter are referred to as "internal" be- 
cause these notions are "uniform" with respect to the effect of external inputs (e.g., 
disturbances). Therefore, the notions are applicable to both certain and uncertain 
systems, and can be regarded as direct extensions of the conventional stability no- 
tions for systems with no external inputs, i.e., for the disturbance-free case. 

A large part of this chapter is also devoted to the presentation of methods of 
proving stability. For testing global stability properties, there exist at least seven 
different methods in the literature, as shown below: 

(1) The first method is based upon analytical solutions. It attempts to obtain basic 
estimates for the solutions of the system by actually solving the differential (or 
difference) equations (or inequalities). 

(2) The second method is based upon transformation techniques. With this method 
basic estimates for the solutions of the system are derived by transforming the 
system into a different system with special properties. 

(3) The third method is based on Lyapunov functions and functional. With this 
method basic estimates for the solutions are derived by means of one (or many) 
Lyapunov functional(s) and comparison lemmas. 

(4) The fourth method is based on small-gain techniques. With this method basic 
estimates for the solutions of the system are derived by means of small-gain 
arguments. 

(5) The fifth method is based on Matrosov functions. 

(6) The sixth method is based on fixed point theorems. 

(7) Finally, one has the method based upon dissipative systems theory. 
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Due to the intimate connection of small-gain results to external stability notions 
(i.e., stability notions which are not uniform with respect to the effect of external 
inputs), the small-gain methods of proving stability will be described separately in 
the following chapters. However, the first three methods are explained in detail in 
the present chapter. Finally, it should be emphasized that the different methods of 
proving stability can be, and often are, combined. For example, one can use Lya- 
punov functionals or analytical solutions to obtain basic estimates for the solutions 
and use small-gain arguments for the stability proof. 

In what follows, Z :— {X, y, Mjj, Mjj, <f>, tt, H) will be a control system with 
the BIC property, U — {0}, and for which e A" is a robust equilibrium point 
from the input u e Mjj . Moreover, mq e Mj/ will be the identically zero input, i.e., 
Mo(0 = e {/ for all f > 0. For the output map // : S)t+ x A" x {/ ^ y, we as- 
sume that either H : dl~^ x X x U ^^ y is continuous or that there exists a partition 
jt — {t,}^q of Ot+ with diameter r > such that H ■.di'^ x X x U ^ y satisfies 
Hypothesis (L2) in Sect. 1.7 of the previous chapter. 



2.2 Definitions of Robust Global Asymptotic Output Stability 
(RGAOS) 

Every stability notion must be defined for systems with solutions that are defined 
for all times t greater than the initial time to. Consequently, the following definition 
plays an important role to the stability notions of the present chapter 

Definition 2.1 We say that a system U is Robustly Forward Complete (RFC) if it 
has the BIC property and for all /? > and T > 0, it holds that 

sup{ ||(/>(fo+5, ^, xq. Mo, '^)||;f ; s e [0, T], \\xo\\x < RJo^ [0, T], d e Mo} < +oo 

We next provide the definitions of Robust Global Asymptotic Output Stability 
(RGAOS) and Uniform Robust Global Asymptotic Output Stability (URGAOS). 

Definition 2.2 We say that U is Robustly Globally Asymptotically Output Stable 
(RGAOS) if S is RFC and the following properties hold: 

PI. 17 is Robustly Lagrange Output Stable, i.e., for all e > and T > 0, it holds 
that 

mp{\\ H [t , (p(t , to, xo, uq, d), 0)\\y; t > to, \\xo\\x <£,toe [0, T],de M^} 

< +00 

(Robust Lagrange Output Stability). 

P2. S is Robustly Lyapunov Output Stable, i.e., for all e > and T >Q, there exists 
&:^8(e,T) > such that 
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\\xo\\x<S toe[0,T] 
^ \\H{t,(t)(t,to,xo,uo,d),0)\\y<s Vt>to,VdeMD- 
(Robust Lyapunov Output Stability) . 

P3. S satisfies the Robust Output Attractivity Property, i.e., for all e > 0, T > 0, 
and ^ > 0, there exists r :— r(e, T, R) >0 such that 

\\xo\\x<R toe[0,T] 
^ ||//(r,(/)(r,fo,-«'o,«o,<^),0)|L < e Wt >to + r,Wd e Mo- 

Moreover, if H(t,x,u) =x, then we say that U is Robustly Globally Asymptoti- 
cally Stable (RGAS). 

Definition 2.3 We say that Z is Uniformly Robustly Globally Asymptotically Out- 
put Stable (URGAOS) if U is RFC and the following properties hold: 

PI. i7 is Uniformly Robustly Lagrange Output Stable, i.e., for every £ > 0, it holds 
that 

sup{||//(r,(/)(f, to,xo,uo,d),0)\\y;t>to,\\xo\\pf;<s,to>Q,de M^} 

< +00 

(Uniform Robust Lagrange Output Stability). 

P2. S is Uniformly Robustly Lyapunov Output Stable, i.e., for every e > 0, there 
exists S :— S(s) > Q such that 

lkollA'<5 tQ>0 

=► ||//(f,(/>(r,fo,^o."0''^)>0)|L < e for all r > fo and J e M^ 
(Uniform Robust Lyapunov Output Stability). 

P3. S satisfies the Uniform Robust Output Attractivity Property, i.e., for all e > 
and R>0, there exists r :— r(e, R) >0 such that 

\\xo\\x<R to>0 
=^ \\H{t,^{t,to,xo,uo,d),0)\\y<E yt>to-\-T,ydeMD. 

Moreover, if H(t, x, u) = x, then we say that E is Uniformly Robustly Globally 
Asymptotically Stable (URGAS). 

The following lemma shows that RFC and property P3 in Definition 2.2 are suffi- 
cient for RGAOS. In other words. Robust Lagrange and Lyapunov Output Stability 
are consequences of the Robust Output Attractivity property. 
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Lemma 2.1 Suppose that E is Robustly Forward Complete (RFC) and satisfies 
the Robust Output Attractivity Property [property P3 of Definition 2.2). Then S is 
RGAOS. 

The proof of Lemma 2.1 is based on the following fact, which exploits the prop- 
erties of the output map. 

Fact I For all T >0 and e > 0, there exists S :— S{e, T) > such that 
sup{||H(f,x,0)||y : \\x\\x<?i,te[<d,T]] <e. 

Proof of Fact I Let T > and e > 0. We consider the following cases: 

Case 1: H : d\~^ x X x U ^ y is continuous. 

In this case, the continuity of the map H : di~^ x X x U ^ y and the fact that 
H(f,0, 0) — for all f > imply that for every t e [0, T], there exists S :— 
S{t, e) > such that 

sup{||//(T,x,0)||y: ||x||;f <3,r >0, |T-r| <^} <e (2.1) 

Due to the fact that the interval [0, T] is compact, there exists a finite number of 
times tj e [0, T], i — I, ..., N, with the property [0, T] C |J.^j ^[max(0, f; - 
S(ti,E)),ti + 8(ti,£)]- By virtue of (2.1), the selection 5(e, 7) = 
min,=i ..._/V S{ti, e) > guarantees that the statement of Fact 1 holds. 

Case 2: There exists a partition it — {t,}^q of JH"*" with diameter r > such that 
H : M"*" X X xU —^ y satisfies Hypothesis (L2) in Sect. 1.7 of the previous chapter. 

In this case, notice that there exists a finite set {tq, . . . , tf^} — it n [0, T] with 
tn+i > T. Using the fact that for each fixed t,- e tt, the mapping A" x [/ 9 (x, m) — ^ 
//(r, , X, m) is continuous with //(t, , 0, 0) = 0, it follows that for every i —0, . . . , N, 
there exists Sj :— 8, (e) > such that 

sup{||H(r/,x,0)||y : HxHa- <3/} <e (2.2) 

By virtue of (2.2) in conjunction with the fact that, for every {xt , x , u) e it x X x U 
and t e [r,-, t;+i), it holds that H(t,x, u) — //(r,-,x, m), the selection S(e, T) — 
niin/^o....,A' ^i (fi) > guarantees that Fact I holds. The proof is complete. D 

We are now in a position to provide the proof of Lemma 2.1. 

Proof of Lemma 2.1 It suffices to show that E is Robustly Lagrange and Lyapunov 
Output Stable, i.e., it satisfies properties PI and P2 of Definition 2.2. First, we show 
that E is Robustly Lagrange Output Stable, by showing that a{T, s) < +00 for all 
r > 0, 5 > 0, where 
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a{T,s) :— sup{ II //(?,(/)(?, to,xo,UQ,d),0)\\y : 

d e Md, t e [to, +00), ||xo||a' < ^, fo e [0, T]} 
By virtue of Robust Output Attractivity Property we have, for every s > 0, 
a(T,s) < s + sup{||//(f,0(r,fQ,xo, uo,d),0)\\y : 

deMD,te [to, to + r(e, T,s)], \\xo\\x <s,toe [0, T]} 

where r :— r(e, T,s) >0 is the time involved in the Robust Output Attractivity 
Property of Definition 2.2. Also, by virtue of Robust Forward Completeness (which 
implies that the set {</>(?, to, xq, mo, d); t e [to, to + r], ||jfo||^ < s,to & [0, T], d e 
Md) is bounded) and since H : Sit"*" x X x U ^ y maps bounded sets of di~^ x 
X X U into bounded sets of 3^, we obtain 

sup{ II H[t, (pit, to, XQ, Mo, d), 0) II y : 

d eMD,t e [to,to + r(E,T,s)], \\xo\\x <s,toe [0,T]} < +00 

Combining the above inequalities, we obtain that a{T,s) < +00 for all T >Q, 
s > 0, or equivalently that U is Robustly Lagrange Output Stable. 

Next, we show that iJ is Robustly Lyapunov Output Stable. Consider arbitrary 
e > and T > 0. By virtue of the Robust Output Attractivity Property, there exists 
r :— r(e, T) > such that, whenever HxqH;!^ < e and to e [0, T}, it holds that 

II //(r, (/)(?, fo, -^0, MQ, i^), 0) |L < e Vf e [fo + t, +oo),Vcf e Mb. (2.3) 

Moreover, by Fact I, there exists 8 :—&{e,T) >Q such that 

sup{ II H{t, x,Q)\y:\\x\\x <l,t e[Q,T + r (e, T)\]<e (2.4) 

where t :— x{e, T) > is the time involved in (2.3). Finally, since e A:" is a robust 
equilibrium point from the input m e Mu for E, it follows that, for all e > and 
r > 0, there exists 5' > such that 

sup{||0(T, fo,-«,Mo,(i)||;^;(ieMz),T e [to,to + x{s,T)\,toe [0, T]] <l{s, T) 

provided that \\x\\x < &' , where r :— r(e, T) > is the time involved in (2.3), and 
& \— S(e, r) > is the positive number involved in (2.4). The above inequality in 
conjunction with (2.4) gives 

sup{||H(r, (/)(t, fo,jc,Mo,<i),0)||-y;cf e MD,r e [to,to + r(E, T)],toe [0, T]] <s 

provided that ||x||;^^ < S' . 

It is clear from (2.3) and the above inequality that the Robust Lyapunov Output 
Stability property is satisfied for S(s, T) — min{e, &']. The proof is complete. D 
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The following lemma must be compared to Lemma 1.1, p. 131 in [17], and 
Proposition 3.2 in [19]. It shows that, for periodic systems, RGAOS is equivalent 
to URGAOS. 

Lemma 2.2 Suppose that E :— (X, y, Mu, Md,(P, tt, H) is T-periodic. If U is 
RGAOS, then E is URGAOS. 

Proof The proof is a direct consequence of Definitions 2.2, 2.3 and from the fol- 
lowing observation: if S :— {X, y, Mu , Md, 41,71, H) is T-periodic, then for every 
(fo, XQ, u, J) e Ot"*" X A" X Mu x Md, it holds that H(t, ^{t, to, xq, u, d), u(t)) = 
H{t - kT,(t){t - kT,tQ - kT,xo, PkTU, PkTd),{PkTu){t - kT)) and </>(?, fo, 
XQ,u,d) — (j){t — kT, fo — kT, XQ, PkTU, Pkid), where k :— [to/T] denotes the in- 
teger part of to/T, and the inputs Pkju e Mu, Pkid e Mq are defined in Defini- 
tion 1.2. D 

Remark 2.1 Notice that Property P3 of Definitions 2.2, 2.3 is not equivalent to 
lim,^+oo \\H{t,(i)(t,tQ,XQ,uo,d),0)\\y — for all (fo,xo,c/) e ('i)\'^ , X , M d) (the 
so-called "weak attractivity property"). In [16] (pp. 191-194) an example of an 
autonomous finite-dimensional system described by ODEs is reported, where a ro- 
bust equilibrium point satisfies the weak attractivity property, but it is not URGAS, 
namely the planar system 

' {. _ x'^(y-x)+y^ 

•" ~ a2+y2)(l + (j:2+y2)2) 

• ^ y'^{y-2x) 

y (.t2+y2)(l_,_(^2_,_3,2)2) 

where the right-hand sides are defined to be zero sX x — y — Q (and consequently 
the right-hand sides are locally Lipschitz functions). The above system satisfies Hy- 
potheses (Hl-4) in Sect. 1.2 of the previous chapter and is RFC. Hence, by virtue 
of Lemma 2.1, it follows that the above system cannot satisfy Property P3. 

Remark 2.2 Obviously, if a system E := (A", 3^, My, Md, </>, tt, /) is RGAS, 
where / denotes the identity mapping (i.e., I(t,x) :— x and X — y) and the 
output function is time-invariant, i.e., H{t,x) = H(x), then the system S :— 
(X, y, Mu, MD,(j),n, H) is RGAOS. However, this conclusion does not hold if 
the output function actually depends on time. For example, consider the system 
with identity output map, 

X — —X X e Dt 

It is clear that the above system is URGAS. However, if we define the output 

Y — H(t,x) — exp(4t)x 

then it is obvious that the above system is not RGAOS. 
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Remark 2.3 The need to impose the Robust Lagrange Stability Property and the 
importance of this property are discussed in [57]. Particularly, in [57] the authors 
present an example of a scalar time-varying system described by ODEs with identity 
output map, where properties P2, P3 of Definition 2.3 hold, and the system is not 
URGAS. Therefore, nonuniform notions of stability are needed for the study of 
time-varying systems. 

We stop at this point in order to emphasize the last phrase of the above comment. 
Since nonuniform stability notions are seldom discussed in details in most books, 
we present an example which illustrates the need for such notions in nonperiodic 
time-varying systems. 

Example 2.2.1 Consider the planar, linear, and time-varying system described by 
the ODEs 

ii(r) = exp(f)x2(r) 

X2(t) — — exp(— f )xi (f ) — 3x2(0 

x(0 = (xi(f),x2(0)e9{2 (2.5) 

The solution of system (2.5) with initial condition x(fo) = (xio, X2o)^ e M^ is given 
by the following equations for all f > fo^ 

x]_{t) = xio[l + (t - ro)]exp(-(f - fo)) +x2o(f - fo)exp(fo)exp(-(f - to)) 
xiit) = -xio(f - fo) exp(-fo) exp(-2(r - fo)) (2.6) 

+ X2q[\ -(t- to)] exp(-2(f - to)) 

If the output Y of system (2.5) is the state component X2, then one can show the 
URGAOS property. Indeed, in this case there exists a constant M > such that the 
solution of (2.5) satisfies |x2(0l < M|xo| exp(— (f — fo)) for all t > to. 

However, if the output Y of system (2.5) is the state component xi, then one 
cannot show URGAOS. To prove this, we notice that the Uniform Robust Output 
Attractivity Property does not hold. If the Uniform Robust Output Attractivity Prop- 
erty were valid, then for all e > and /? > 0, we would obtain the existence of 
r :— r(e, R) >0 such that for every to > 0, X2o e di with |x2o| < R and t — to> r, 
the following inequality would hold: 

|-^i(0| = \x2Q\(t - ro)exp(fo)exp(-(f - fo)) < s (2.7) 

Notice that we have considered the solution of (2.5) with xio = 0. Clearly, (2.7) 
holds for all f > fo if 7?exp(fo - 1) < e and for all f > fo + A(-| exp(-fo)) if 
/?exp(fo — 1) > e, where A :— A(-| exp(— fo)) > 1 is the unique solution of the 
equation Aexp(— A) = -^ exp(— fo). Notice that A(-| exp(— fo)) > ln( j exp(fo)) and 
therefore the assumption of Uniform Robust Output Attractivity Property leads to 
contradiction, because we must have r(e, R) > A(-| exp(— fo)). 
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Finally, it should be noted that the Robust Output Attractivity Property holds if 
the output Y of system (2.5) is the state component xi. In this case, we can prove 
RGAOS using (2.6) (but not URGAOS). Thus, nonuniform stability notions arise 
naturally in the study of the simple system (2.5). 



2.3 KL Characterizations 

This section is devoted to the proof of two basic results, which provide characteri- 
zations of the RGAOS and URGAOS in terms of KL functions. 

Theorem 2.1 Consider a control system E :— {X , y, Mfj, Mo, (p, Jt, H) with the 
BIC property and for which Q E X is a robust equilibrium point from the input 
u e Mij . Then the following statements are equivalent: 

(i) r is RGAOS. 

(ii) There exist functions p, P € K^ and a e KL such that for every {tQ, XQ,d) G 
D{+ X A" X Mo , we have 

\H(t,(p(t, to, XQ, MO, li), O) ||-y + p(t)\\(l>(t, to, xo, MO, d)\\^ 

<(T{Pito)\\xo\\x,t-to) for all t> to. (2.8) 

(iii) There exist functions y, fi e K'^ , a e Kcx^, a e KL and a constant R >0 such 
that for every (to, xo, d) € Sit"*" x A" x Mo, we have: 

\H{t, (Pit, to, xo, MO, d), 0) \\y <(T{p(to){\\xo\\x + R),t- to) Vf > to (2.9) 

\\(p(t,to,xo,uo,d)\\.^<Y(t)a{P(to){\\xo\\x + R)) Vr > fo- (2.10) 

Theorem 2.2 Consider a control system E :— (X, y, Mu , Mo, </>, tt, H) with the 
BIC property and for which Q E X is a robust equilibrium point from the input 
u e Mu . Then the following statements are equivalent: 

(i) E is URGAOS. 

(ii) E is RFC, and there exists a function a e KL such that for every {to, xo, d) G 
S)}"*" y. X y. Mo, we have 

\H{t,(t){t,to,xo,uo,d),Q)\y<a[\\xo\\x,t -to) forallt>to. (2.11) 

For the proof of Theorems 2.1 and 2.2, we need some technical lemmas that 
illustrate useful properties of the functions of classes Koo and K~^. 

Lemma 2.3 Let a : di.~^ x Di"*" — >• Di"*" be a function with a(-,0) = that satisfies the 
following properties: 

1. for each fixed ? > 0, the mapping a(t, ■) is nondecreasing, 

2. for each fixed .? > 0, the mapping a(-, s) is nondecreasing, 

3. limj_^o+ ^0, *) = Ofor all t >Q. 
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Then there exists a pair of functions ^ e K^^ and y € A""*" such that 

a{t,s)<^{Y(t)s) forallit,s)e{m+f (2.12) 

Proof of Lemma 2.3 Without loss of generality we may assume that a e C''(J){"'" x 
Dt"*"). Indeed, otherwise we may consider the function 

\\f^' fl+^a{r,^)drd^ fori>0 
a(t,s):^ \ ■ 

[O for s = 

which by virtue of the inequality a(t, s) < ait, s) < a(t + 1, 2^) is in C''(M"'" x 
OJ"*") and satisfies fl(-, 0) = 0. Notice that a has the same Properties 1, 2, 3 of our 
statement with a . 

By invoking Property 3, for every f > 0, there exists S(t) in (0, 1) such that 

1 
s<S(t) => a(t,s)< (2.13) 

Define the following function: 

m-^{[t] + l-t)S{[t] + l) + {t-[t])S{[t] + 2) t>0 (2.14) 

where [f] denotes the integer part of f > 0. Notice that by definition (2.14) it 
follows that fjik) = 8(k + 1) and lim,^(fe+i)- fjit) = 8{k + 2) for all k e Z+, 
which implies that fj is continuous. Moreover, definition (2.14) gives < ri(t) < 
max{^([f] + 1); S([t] + 2)} for all f > 0, which in conjunction with (2.13) implies: 

i<5([f] + l)orl a{[t] + I, s)<rj^ or] 

s<fi(t) =^ \ ^ , i 

^<H[t] + 2) I a([t] + 2,s)<^, J 

The above inequality, combined with the fact that t < [t] + 1 < [t] + 2 and Prop- 
erty 2 for a, gives: 

1 

s<r]{t) =^ a{t,s)< (2.15) 

Next, define the following function: 

);(?):= exp(—r) min fj(x) (2.16) 

0<T<f 

which is a C^ strictly decreasing function rj : 9t+ -^ (0, +oo) with limr^+oo rj(t) 
— and such that 

1 

s<r}{t) ^ a(t,s)< (2.17) 

?+ 1 
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Let jLi be the inverse function of rj defined on (0, ri{Q)] being nonnegative, continu- 
ous, and strictly decreasing witii lim,^o+ /x(f) — +oo. Define 

ti(s):^\ (2.18) 

if s > r](0) 

It turns out that /i : (0, +oo) -^ iU+ is nonincreasing, continuous, nonnegative, and 
satisfies hmf^o+ A(0 — +oo. Additionally, define 

fo if 5 = 

P(s):^s+\ (2.19) 

[supo<^<,fl(/x(r),r) if5>0 

We next show that P e Koo- Indeed, by definition (2.19) it follows that P(0) — and 
P is strictly increasing with lim.5^-|_oo Pis) — +oo. The continuity of p on (0, +oo) 
follows from the fact that both a and jl are C" on (0, +oo). Furthermore, notice that 
(2.17) and (2.18) imply 

a{^lir),r)<- for all t e (O, r;(0)]. (2.20) 

Since lim5^o+ jl(s) — +oo, it follows from (2.20) that limj^o+ P(s) — 0, and this 
establishes the continuity of P at zero. Let ^(s) := a{s, s) + Pis). Obviously, f (■) 
is of class Koo- Moreover, when s > t,hy virtue of Property 2 for a, it holds that 
ciit, s) < ais, s) < ^is), which implies 

rhait^ 

sup < 1 (2.21) 

i>r>0 s 

Also, when < s < rjit), it follows from (2.18) that fi{s) > t, and hence, by Prop- 
erty 2 for a and (2.19), ait, s) < aijlis), s) < C,is). The latter implies that 

^~^ia{t,s)) 
sup - — \^.±J1 < 1 (2.22) 

0<.s<))(r) s 

Using Property 1, (2.21), and (2.22), we get 

r\ait,s)) r\ait,s)) r'iait,t)) 

sup < 1 + sup < 1 H (2.23) 

s>Q s t](t)<s<t s rjit) 

Let, finally, y be any function of class K~^ which satisfies 

t-\ait,t)) 
y it) > - — ^—^^-^ + 1 for all f > (2.24) 

77(f) 

The desired (2.12) is a consequence of (2.23) and (2.24). D 
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Lemma 2.4 Let a : !){"*" — >• Dt"*" be a locally bounded function with lim^^o+ '^^^) — 
fl(0) — 0. Then there exists a function f e A'cxd such that 

a(s)<l;(s) for alls >0 (2.25) 

Proof of Lemma 2.4 Define a{s) :— supo<j.<^ a(r) and notice that a is nondecreas- 

ing with lim^^o+ ^(■s) — a(0) — 0. Define f (i') := .s + ^ f^ ''' a{^) d^ for s > and 
^(0) := 0. The desired (2.25) is a consequence of previous definitions. D 

The following three technical lemmas provide essential estimates of the output 
and state behavior for RGAOS systems. 

Lemma 2.5 Suppose that the control system S :— (X , y, Mjj , Mo, 0, ^, H) with 
outputs is RGAOS. Then there exist functions a e KL and fi e K'^ such that the 
following estimate holds for all (to, xq, d) € Dt"*" x A" x Mo and t > Iq: 

\\H{t, (pit, to, XQ, MO, d), O) \\y < cr (;S(fo)||xo||A', ^ - to) (2.26) 

Proof of Lemma 2.5 Let ^,T >0, s >0, and define: 

a(T,s) :— sup{||//(r,(/)(f,fo,-^o,Mo,'^),0)|L -.d e Mo,t > ro, 

\Uo\\x<s,toe[0,T]] (2.27) 

M(^, T, s) := sup{ II //(fo + §,0(^0 + ?, ?o, xq, uq, d), 0)\y:deMo, 

\\xo\\x<s,he[0,T]] (2.28) 

First notice that by virtue of Robust Lagrange Output Stability a is well defined, 
i.e., a{T, s) < +oo for all T > 0, i' > 0. Furthermore, notice that M is well defined, 
since by definitions (2.27), (2.28) the following inequality is satisfied for all §, T > 
and s >Q: 

M(^,T,s)<a(T,s) (2.29) 

Notice that, a satisfies all hypotheses of the Lemma 2.3, namely, for each fixed 
s >0, a(-,s) is nondecreasing, and for each fixed T >0, a(T, ■) is nondecreasing 
and satisfies (3 (■, 0) — 0. Furthermore, Robust Lyapunov Output Stability asserts that 
for every T > 0, lim^^o+ ^iT, s) — 0. It turns out from Lemma 2.3 that there exist 
functions C,\ e Kqc and y e K'^ such that 

aiT, s) < Ci {y{T)s) for all (T, s) e {m+f (2.30) 

Without loss of generality, we may assume that y e K~^ is nondecreasing. Inequal- 
ity (2.30) in conjunction with (2.29) implies 

M(.^,T,s)<^i{yiT)s) foTa\l{^,T,s)e{m+f (2.31) 
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Moreover, the Robust Output Attractivity property guarantees that for all e > 0, 
T >0,andR> 0, there exists r^r{s,T,R)>0 such that 

M{^,T,s)<£ forall^>r(£,T,R)andQ<s<R (2.32) 

Let 

g{s):^^s + s^ (2.33) 

and let /? be a nondecreasing function of class K^ with p(0) — 1 and 

lim /7(f) = +oo (2.34) 

r->-+cio 



Define 

M(^,T,s) 



M(f ) := sup 



T>0,s>0\ (2.35) 



[p(T)g{^i{y{T)s)) 

Obviously, by (2.31) and (2.35) the function /x : di'^ —^ 9{"'" is well defined and 
satisfies /^(■) < 1. We show that lim^^+oo m(?) — 0, or, equivalently, we establish 
that for any given e > 0, there exists a ^ = 5(e) > such that 

/x(?)<e for t> 5(e) (2.36) 

Notice first, that for any given e > 0, there exist constants a :— fl(e) and b :— b{£) 
with Q < a <b such that 

xi{a,b) ^ "" <s (2.37) 

^x + x^ 

We next recall (2.34), which asserts that, for the above e for which (2.37) holds, 
there exists c :— c(e) > such that p(J) > - for all T >c. This by virtue of (2.37) 
and (2.31) yields 

< e for all ^ > 0, when T > c or f i (y{T)s) i (a, b) (2.38) 

p{T)g{l;i{YiT)s)) 

Hence, in order to establish (2.36), it remains to consider the case 

a<l;i{Y{T)s)<b and Q<T<c (2.39) 

Since, for each fixed {^,s) e (Si"*")^, the mappings M(§, -,.?), M(^, T, ■), k(-)> and 
/?(■) are nondecreasing, we have 



M(t,r,.) M(^,c,^) 



p{T)g{l;i{Y{T)s))- g(a) 

provided that (2.39) holds. By using (2.32) with 

e :— esia) T .— c R.— — 

^ y(0) 



(2.40) 
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it follows that 

M(^,c,^-^-^)<sg(a) foT^>S(s):^r(sg(a),c,^-^-^) (2.41) 
V K(0) / V K(0) / 

By taking into account (2.38), (2.40), (2.41), and definition (2.35) of /x(-) it follows 
that (2.36) holds with S — 8(e) as selected in (2.41). Since e > is arbitrary, we 
conclude that lim^^+oo M(t) = 0. Define 

jl{t) :— sup fji(r) for f > 0; il(t) :— sup fiir) for r < (2.42) 

T>f T>0 

Clearly, /i(-) is a nonincreasing function with lim^^-i-oo A(t) — and /x(f) > ii(t) 
for all t > 0. Next define, for t > 0, 



/' 

Jt-i 



/x(f) := exp(-f) + / il{w)dw (2.43) 

Notice that ft : Di"*" -^ (0, +oo) is a continuous strictly decreasing function such 
that /i(^) > /Lt(^) for all § > and limj^+oo AC?) — 0- Thus, by recalling defini- 
tion (2.35) we obtain 

M(^,T,s)<fL(^)eiT,s) for all (r, .?) e (M+)^ and ^ > (2.44) 

where 9(T,s) :— p{T)g(^i{Y(T)s)). Clearly, 6 satisfies all hypotheses of Lem- 
ma 2.3, and therefore there exist f e Koo and /6 e A""*" such that 

d(T, s) <^{P(T)s) for all (T, s) e {di+f (2.45) 

The desired (2.26) is a consequence of (2.28), (2.44), and (2.45) with a(s, t) :— 
fl(t)^(s) (which is a KL function). D 

Lemma 2.6 Suppose that the control system S :— {X , y, My, Mo, <p, it, H) with 
outputs is URGAOS. Then there exists a function a e KL such that the following 
estimate holds for all (fo, xq, d) e M"*" x A" x Md and t > to: 

II H{t, (Pit, fo, xo, uo, d), 0)\\y< cr(||xo|| A-, t - to) (2.46) 

Proof of Lemma 2.6 Let ^ > 0, .s > 0, and define 

a(s) :— sup{||//(/,0(r, to,xo,UQ,d),0)\\y : 

de MD,t>to,\\xo\\x <s,to>0} (2.47) 

M(t, s) := sup{ \\H{to + ?, 0(fo + f , fo, ^o, mq, d), O) f^ : 

JeMz), IIxoIIa- <^,ro>0} (2.48) 

First notice that by virtue of Uniform Robust Lagrange Output Stability, a is well 
defined, i.e., a{s) < +oo for every s >0. Furthermore, notice that M is well defined, 
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since by definitions (2.47), (2.48) the following inequality is satisfied for all f > 
and s >0: 

M(^,s)<ais) (2.49) 

Notice that a is nondecreasing (and consequently locally bounded). Moreover, Uni- 
form Robust Lyapunov Output Stability asserts that lim^^Q+ a{s) — a(0) — 0. It 
turns out from Lemma 2.4 that there exists a function ^i e Koc such that 

a{s) < ^lis) for all 5 > (2.50) 

Inequality (2.50), in conjunction with (2.49), implies 

M(^,s)<^iis) forcd\(^,s)e{m+f (2.51) 

Moreover, the Uniform Robust Output Attractivity property guarantees that for all 
£ > and R>0, there exists r — r{E, R) >0 such that 

M{^,s)<E forall^>T{s,R)iindO<s<R (2.52) 

Let 

gis):^V^ + s^ (2.53) 

and define 

M(f ) := sup ——-— 
(gi^iis)) 

Working exactly as in the proof of Lemma 2.5 and using (2.51), (2.52), (2.53), 
and definition (2.54), we may establish the existence of a continuous strictly 
decreasing function fi, : di~^ -^ (0, +oo) with /x(^) > /x(^) for all ^ > and 
lim^^-i-oc m(?) — 0. Thus, by recalling definition (2.54) we obtain 

M(^,s)<fL{^)0{s) forallt,5>0 (2.55) 

where 9(s) :— g(^i(s)). The desired (2.46) is a consequence of (2.48) and (2.55) 
with a{s, t) :— jl{t)6{s) (which is a KL function). D 

Finally, the following lemma provides an estimate for the transition map, which 
turns out to be a necessary and sufficient condition for Robust Forward Complete- 
ness for systems which are not necessarily RGAOS. 

Lemma 2.7 Consider a control system S :— {X, y, Mu , Mp, </>, n, H) with the 
BIC property, U — {0}, and for which & X is a robust equilibrium point from 
the input u e Mj/ . E is RFC from the input u if and only if there exist functions 
(U, /J e K'^ and a € KL such that for every (fo, xq, d) € Dt"*" x A:" x Md, we have 

iJi{t)\(l){t,tQ,XQ,UQ,d)\^ <a{^fi{tQ)\\xQ\\x,t — to) forallt>to (2.56) 



s>0\ (2.54) 
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Proof of Lemma 2.7 Suppose first that S is RFC from the input u. Define 

a>(T, s) :— sup{|(/)(fo + h,to,xo,uo,d)\\^; \\xo\\x < s, 

toe[0,T],he[0,T],deMD} (2.57) 

Notice that by virtue of Robust Forward Completeness from the input u, the function 
a> : di~^ X Sit"*" —>■ di~^ is finite valued and for each fixed t >Q, the mappings a>(t,-) 
and a>(-,t) are nondecreasing. Moreover, definition (2.57) implies that for every 
(fo, xo,d) e di~^ X X X Mj), the transition map satisfies 

||0(f, ro,xo, Mo,<^)||_;t' < <w(f, ||xo||;f) forallf>fo (2.58) 

Since for each fixed ? > 0, the mappings &)(?, ■) and &)(■, t) are nondecreasing, in- 
equality (2.58) implies 

||(/)(r,fo,xo,Mo,'^)||;^^ <(^{t,t) + o){\\xQ\\x, \\xq\\x) for all f > fo (2.59) 

Let y e A" "•" be a nondecreasing continuous function that satisfies \+a){s,s) < yis) 
for all 5 > (e.g., yis) := 1 + f'^^ «(f , ^)d^) and define 

f^(l + y(0)) forO<^<l exp(-0 

ais) :— s + \ and ij.{t) :— 

[l + y(5-l) forj>l y(0 

with a e Kqo and fj. e K^ . It follows that the following inequalities hold for all 
s,?>0: 

«(?, + a}{s, s) < yit) + yis) < y(t){l + y(s)) < y{t)a(l + s) (2.60) 

Inequalities (2.59) and (2.60), in conjunction with (2.58) and definition of /x e K'^ 
above, imply that for every (to, xo,d) e !H"'" x X x Mo, the transition map satisfies 

fi{t)\(t){t,tQ,XQ,UQ,d)\.^<tx^{—t)a(\\xQ\\x + '^) forallf>fo (2.61) 

Consider the control system E' :— {X, X, My, Mo, </>, 7t, H) with U — {0}, where 

H{t,x,Q)■.^^l{t)x (2.62) 

It can be immediately verified that E' :— (X , X, Mjj , Mo, </>, it, H) is a control 
system with outputs and the BIC property and for which e A" is a robust equi- 
librium point. Moreover, by virtue of (2.61) and Lemma 2.1, it follows that E' is 
RGAOS. Consequently, Lemma 2.5 guarantees the existence of functions a e KL 
and p e K^ such that (2.56) holds for all {to, xq, d) e i)i+ x X x Mo and t > fo- 

Conversely, suppose that (2.56) holds for the transition map of E. Clearly, by 
virtue of the BIC property, for each (fo, xo,d) e di~^ x X x Mo, there exists a maxi- 
mal existence time, say, fmax e M"*" U {+cxd}, such that [fo, fmax) x {(to, xo, uo, d)} C 
A0 and for all f > fmax, it holds that (f , fo, xo, mo, rf) ^ A^. In addition, if fmax < 
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+00, then for every M > 0, there exists t e [?o, Wx) with ||0(f, Iq, xq, uq, d)\\x > 
M. Suppose that rj^ax < +00 for some (Iq, xq, d) e Dt"*" x X x Mq. Then there ex- 
ists t e [fo,?max) with \\(l>it,to,xo,uo,d)\\x > cr(/S(fo)||xo||;f,0)maXfg[o,f„,^] ^. 
On the other hand, since (2.56) holds, we obtain 

II II / X 1 

\\(t)it,to,xo,uo,d)\\y <(j(Pito)\\xQ\\x,0) max ^— 

which is clearly a contradiction. Thus, since (2.56) holds, we must have fmax — +00 
for all (fo, XQ, d) e M+ x X x Mo- Moreover, using (2.56) for all e > and T >0, 
we obtain 

sup{||(/>(ro + s, t(j,xo, uo,d)\\-^; s e [0, T], \\xq\\x < e, fo e [0, T],d e Md} 

1 



a(s max P(t),0) 
V ie[O.T] / te 



< +00 



fe[o,2r] /x(r) 
i.e., the property of Robust Forward Completeness from the input u is satisfied. D 

We are now in a position to prove the main results of the section. 

Proof of Theorem 2.1 The implication (ii) =► (iii) is obvious. The implication 
(iii) =► (i) follows immediately by applying the results of Lemma 2.1 and the def- 
inition of RPC. To be more precise, notice that inequality (2.10) implies that E is 
RFC and (by virtue of the properties of the KL functions) estimate (2.9) implies that 
E satisfies the Robust Output Attractivity Property. Consequently, since e A" is a 
robust equilibrium point, it follows by virtue of Lemma 2.1 that E is RGAOS. 

Next we prove implication (i) =► (ii). Suppose that E is RGAOS. Then Lem- 
mas 2.5 and 2.7 guarantee that there exist functions g e KL, a e KL, and j6, j6, // e 
K^ such that the following estimates hold for all (fo, Xi^, d) e di^ x X x Mo and 
f >fo: 

\\H{t,(p(t, to,xo, uo,d), 0)\\y< a{P(to)\\xo\\x, t - fo) (2.63) 

At(f)||(/>(f, fo, XQ, Mo, i^)!;;. < C! [^{to)\\XQ\\x , t - fo) (2.64) 

Estimates (2.63) and (2.64) imply (2.8) for cr(.j, t) := a{s, t) + a(s, t) and p{t) := 
max{y6(f), Pit)]. The proof is complete. D 

Proof of Theorem 2.2 The implication (i) =► (ii) is a direct consequence of 
Lemma 2.6. The implication (ii) =^ (i) follows directly from the properties of KL 
functions. D 



2.4 Transformations Preserving RGAOS 

The method of verifying RGAOS using transformations is used frequently in Math- 
ematical Control Theory and Stability Theory. Roughly speaking, we want to verify 
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RGAOS for a system S which is the transformation of another system S' (in the 
sense described in Sect. 1.6 of Chap. 1). Suppose that we can establish that S' 
is RGAOS (using another method, e.g., by solving the differential (or difference) 
equations (or inequalities)). Then RGAOS for Z is guaranteed under some addi- 
tional technical assumptions that are presented below. 

We start with the following elementary observation, which is a direct conse- 
quence of Definitions 1.4, 1.7, and 1.8. 

Lemma 2.8 Consider a control system E :— (X ,y, My , MD,<p,Tt, H) which 
is RFC from the input u. Let <P : Sit"*" x X ^ X be a change of coordinates, 
and q : DJ"*" x V — >• t/ a transformation of V onto U. Then system S' :— 
(X, y, Mv, Md,4>', Tt', H') defined by (1.106), (1.107), (1.108) is a control sys- 
tem which is RFC from the input v G My ■ 

Making use of the results of Lemma 1.2, Theorems 2.1, and 2.2, we are in a 
position to show the following propositions. 

Proposition 2.1 Consider a control system S :— (X, y, Mu, Mo, 4>, Tt, H) with 
U — {0}, which satisfies the classical semigroup property and the BIC property, 
and for which e X is a robust equilibrium point from the input u € My . Suppose 
that U is RGAOS. Let <P : Dt"*" x X ^ X be a change of coordinates. Then, U' :— 
(X, y, Mu,Md,(P', n', H') defined by (1.106), (1.107), (1.108) with V = [/ = {0} 
is RGAOS. Moreover, if F is URGAOS and there exists a e K^o such that 

\0~\t,x)\^<a(}\x\\x) forall{t,x)em+ xX (2.65) 

then system S' := (X, y, Mu,Md, (j)' , tt' , H') defined by (1.106), (1.107), (1.108) 
with y = f/ = {0} is URGAOS. 

Proof By virtue of Lemma 1.2, X" :— (X, y. My, Md,(J)' , tt' , H') is a determin- 
istic control system which satisfies the classical semigroup property and the BIC 
property. Moreover, e A" is a robust equilibrium point from the input u for E' . By 
virtue of Lemma 2.8, system X" := {X , y, Mu , Md,(I)' ,tt' , H') is RFC from the 
input u . 

Finally, notice that by virtue of Lemma 2.5, there exist functions ct e KL and 
yS e A'+ such that estimate (2.26) holds for all {to,xo,d) e *){+ x A" x Md and 
t > to. Definitions (1.106) and (1.108), in conjunction with (2.20), imply that the 
following estimate holds for all (ro, xo,d) e di~^ x A" x Mo and t >to: 

II H'{t, (P'(t, to, xo, MO, d), 0) II -y = \\H{t,(t>{t, to, 'P~\to, xo), uo, d), O) || -^ 

< CT (/S(fo) \^~\to, xo)\p^,t- to) (2.66) 

Since : Dt"*" x A* ^- A" is a change of coordinates, there exists a e Koc and y e K~^ 
such that ||£p~'(f,x)||;t' < a(y(OlkllA') for all (t,x) e Dt"*" x X. Consequently, we 
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\\H'{t, (P'it, tQ, XQ, MO, d), 0) \\y <(j{P(tQ)a{Y(tQ)\\xQ\\x), t - ?o) (2.67) 

The above inequality shows that properties PI, P2, and P3 of Definition 2.2 hold, 
and consequently E' := {X, y, Mu, Md,(I>', tt', H') is RGAOS. Moreover, if E is 
URGAOS and inequality (2.65) holds, then we obtain 



\H' [t ,(l)' {t ,tQ, XQ,U{),d),Q)\y < ^{^xo\\x,t - to) 



(2.68) 



where d(s, t) :— cT(a{s), t) is a KL function. In this case, Theorem 2.2 guarantees 
that E' := (X, y, Mu,Md,(P', tt' , H') is URGAOS. The proof is complete. D 



Example 2.4.1 Transformation methods were used in the early stages of Stability 
Theory to derive conditions for asymptotic stability of linear systems described by 
ODEs, i.e.. 



X — Ax X e ilt" 



(2.69) 



where the matrix A e S){"^" is constant. The Jordan theorem on canonical represen- 
tation of matrices guarantees the existence of a nonsingular matrix P e di"^'^ such 
that 



(2.70) 



where Ji, . . . , Jr are the so-called Jordan blocks corresponding to the eigenvalues 
Xjc — aji+iPk (k— !,...,«) of the matrix A e ;)i"^" (here ( denotes the imaginary 
unit). Particularly, blocks Jk which correspond to real eigenvalues Xt—at^ iM have 
the form 







'Ji 


. 















Jl ■ 
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= A = 
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. Jr-l 
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Jr 



Jk = [ak] or Jk : 



Ok Yk 
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01 








ak 


n 





ak_ 



with Yky^O 



(2.71) 
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and blocks J^ which correspond to complex eigenvalues X^ — a^ -\- ifik have the 
form 



Jk = 



ak Pk 
-fik ak 



with 



Kk 



Consider the linear system 





'Kk 


Lk 















Kk ... 








or Jk^ 















... 


Kk 


Lk 







... 





Lk 


ak Pk 
-Pk ak _ 




Lk = 


'Vk 



0" 

Yk_ 




Zi ^ JiZi I ^ 


l,...,r 






Y^p-h 








2 = (z p . . 


.,4 


)' e 9r 









(2.72) 



(2.73) 



where J\, . . . , Jr are the Jordan blocks of A e J){«><" that appear in (2.70), and P e 
gfjnxn j^ jj^g nonsingular matrix involved in (2.70). It should be clear from (2.70) that 
system (2.69) is the transformation of system (2.73) corresponding to the change of 
coordinates <f (f, z) '.— P~^z. On the other hand, system (2.73) is the transforma- 
tion of system (2.69) corresponding to the change of coordinates 0{t,x) :— Px. 
Consequently, by virtue of Proposition 2.1, system (2.73) is URGAOS if and only 
if system (2.69) is URGAS. 

The reader should notice that the solution of system (2.73) can be found explicitly 
(due to the simple structure of the Jordan blocks given in (2.71) and (2.72)). The 
formulae for the solution of the solution of system (2.73) show that if Jk is one of 
the blocks described in (2.71) and (2.72) and Uk < 0, then the solution of Zk — JkZk 
satisfies \zk(t)\ < Mk ex.p{—crk{t — to))\zk{tQ)\ for all t > to, where Mk>l and ak e 
(0, —Ok] are appropriate constants. Consequently, if all eigenvalues of the matrix 
A e J){"^" have negative real parts, then we have, for all t >tQ, 



\Yit)\ <exp{-a(t - to))\zito)\\p-^\J2Mk 



(2.74) 



k==l 



where a :— minfa^, k= I, .. . ,r}. Estimate (2.74) implies that system (2.73) is UR- 
GAOS. Moreover, if Jk is one of the blocks described in (2.71) and (2.72) and 
cik > 0, then the solution of zk — JkZk does not converge to zero for all initial con- 
ditions. Thus if one of the real parts of the eigenvalues of A e ;){« x« is nonnegative, 
then system (2.73) is not URGAOS. 

Thus, we have shown that system (2.69) is RGAS if and only if all eigenvalues 
of the matrix A e !1{"^" have negative real parts. 
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2.5 Differential Inequalities and Comparison Lemmas 

The purpose of this section is to present basic tools that enable us to handle differ- 
ential inequalities. Differential inequalities can be used to obtain estimates of the 
state of a control system. The derived estimates can be further utilized for the proof 
of RGAOS (this is essentially the first method of proving stability, the method of 
analytical solutions) or can be combined with the method of Lyapunov functionals 
(as will be shown in the following section). 

We start with two technical lemmas which show how one can obtain inequalities 
for continuous functions using differential inequalities. 

Lemma 2.9 Let y :[tQ,ti) ^f- 'i)\ be an absolutely continuous function, where tQ < 
h < +00, and suppose that the following implication holds for certain constants 
a > b: 

"Ifb < y(t) < a for some t e [tQ, ti) and y(t) exists, then y{t) > 0." 

Then, the following implication holds: 

"Ify{to) > a, then y(t) > a for all f e [to, ti)." 

Proof The proof is made by contradiction. Suppose that there exists t e (to,ti) such 
that y(t) < a. Without loss of generality we may assume that y(r) > b for all r e 
[to, t), because if the set 5 := {r e [to, t} : y(r) < b] is nonempty, then we may 
define t :— infB, which satisfies t > to and y(r) > b for all r e [to, t), and replace 
te{to,ti)hyte(to,ti). 

Since y{to) > a, by continuity of y : [to, ti) —^ dl it follows that the set A := {t e 
[to, t) : y(r) — a] is nonempty and closed. Let T :— sup A and notice that by virtue 
of continuity of y : [to, fi) -^ di and the fact y(t) < a, we get T < t. Consequently, 
we have y{r) ^ a for all r e (T, t] and y(T) — a. More specifically, we have y(r) < 
a for all r e (T, t] (since the existence of r e (T, t] with ^(r) > a would imply the 
existence of certain f e (r, t) with y{^) — a and thus contradicting the definition of 
T :— sup A). Consequently, the assumed implication gives y(r) >Q for almost all 
t e(T,t). 

Since y(t) = y{T) + fj y(s)ds, we obtain y{t) > y(T) — a, which contradicts 
the hypothesis y{t) < a. The proof is complete. D 

Lemma 2.10 Let y : [to, ti) ^ M be a continuous function, where to < ti < +oo, 
and suppose that the following implication holds for certain constant a e dl: 

, y(t + h)-y(t) 
"Ify{t) — a for some t e [to, t\}, then D^yit) :— limsup > 0." 

Then, the following implication holds: 

"If y{to) > a, then y(t) > a for all f e [to, ti)." 
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Proof The proof is made by contradiction. Suppose that there exists t e (?o, ^i) such 
that yit) < a. Since yito) > a, by continuity of y : [to, fi) -^ di it follows that the 
set A:— {r e [to, t) : y(r) = a] is nonempty and closed. Let T :— sup A and notice 
that by virtue of continuity of y : [to, ?i) ^- 8t and the fact y(t) < a, we get T < t. 
Consequently, we have y{x) ^ a for all t e {T, r] and y(T) — a. More specifically, 
we have ^(t) < a for all r e (T, t] (since the existence of t e (T, t] with ^(r) > a 
would imply the existence of certain § e (r, t) with y(^) — a and thus contradicting 
the definition ofT:— sup A). 

Thus, for sufficiently small /z > 0, we obtain ^ "*" j~^ ' < 0. Taking limits, 
we get D'^y(T) :— limsup;,^o+ ^ l~^ — 0' contradicting the hypothesis that 
D^y(T) :— limsup/j^o+ ^ ^~-' > 0. The proof is complete. D 

We continue with a technical lemma which provides estimates involving KL 
functions . The reader should recall that a function /xisofclassfif/u,eC'^(8'l"'";9'l"'") 
with limf^+oo fJ-it) — and f^ °° /x(f ) dt < +oo. 

Lemma 2.11 For every pair of functions p : di~^ — >• !){"*" being C positive definite 
and fi being of class £ with p(t) > for all t >0, there exists a KL function a : 
(di~^) '~^ ^^^ which satisfies the following property: 

(P) If c e [0, 1] is a constant, to > 0, and y : [to, +oo) — >• DJ"*" is an absolutely 
continuous function that satisfies the following differential inequality for almost 
all t >to'. 

(2.75) 



(2.76) 



Proof Let G(p, p,c,to) be the set of all absolutely continuous functions y : 
[to, +oo) -^ di~^ which satisfy differential inequality (2.75) a.e. for r > fo > and 
ce[0, 1]. 
Define 

g(s):^^+s'- (2.77) 

y(to + ^) 









y(t)< 


-p{y(t)) + cp(t) 






then 


the following 


estimate holds: 












y{t)< 


<> 


r+oc 

(to) + c ) 

J to 


i(s)ds,t - 


- to for all t 
J 


>to 



v(^) := sup — ; y e G(p, p, c, to), c e (0, 1], ro > 

[g(y(to) + cf+'^p(s)ds) 

(2.78) 

We will next show that v(t) < 1 for all r > and hm/^+oo v(t) — 0. Let i; : i)i+ -^ 
[0, +cxd) be a nonincreasing C" function with v(t) < v(t) for all f > and such 
that lim,^_|_oo v(t) — (for example, take v(t) :— supj>, v(s) for f > and v(t) :— 
v(0) for t < 0, which is a nonincreasing function with v{t) < v(t) for all r > 
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and lim,^_|_oo v(t) — 0, and define v(t) :— J^_^ v(s)ds for t > 0). Define the KL 
function 

G(s,t):^g(s)v{t) (2.79) 

Then, definitions (2.78) and (2.79) imply that (2.76) is fulfilled for all y e 
G(p, II, c, to) with c e (0, 1] and to > 0. Finally, the case c = is implied by the 
continuity of (j{s, t) :— g{s)v(t). 
First, notice that (2.75) yields 

yit) < y(to) + c /x(i) ds for all t > to (2.80) 

Jto 

for all y e G(p, /x, c, fo)- Since limf^+oo m(0 = for any constants r > e > 0, 
there exists a time r:=r(e,r)>0 such that 



f > T ^ fi{t) < min 



\p(sy/^<s<r\ (2.81) 



Let < e < r. We now show the following implication for all y e G(p, jj., c, to): 

If ri > r(£, r) and}'(ri) <e, then y(r) < e, Vr > ri (2.82) 

To see this, notice that, when r > y(t) > | and t > r(e,r), then by (2.75) 
and (2.81) we have 

^(0 < -p{y(t)) + M(0 < -\p{yit)) < (2.83) 

Lemma 2.9 and the above inequality show that implication (2.82) holds. We next 
establish that, if we define 

T(s,r):^r(s,r) + - ^^—— (2.84) 

mmE <s <r p{s) 

then the following is fulfilled for all R>0 and e > with s < R + M: 

For all t>to + T{e, R + M) and y e G(p, fi, c, to) with y(to) < R^ y(0 < e 

(2.85) 
where M :— /q °° ii{t)dt > 0. Indeed, otherwise, by implication (2.82), there 
would exist R>0 and e > with s < R + M, y e G(p, ijl, c, to) with y(to) < R, 
and t > to + T(s, R + M) such that y(t) > s. Since t > r(e, R + M), we would 
have, by virtue of (2.80) and (2.82) with r^R + M, 

y{t)>s fov&Wt e[to + r{e,R + M),to + T{s,R + M)] (2.86) 

On the other hand, by (2.75), (2.80), (2.81), and (2.86) it follows that 

1 
y{t)< — min p{s), ior aWt e\to + r(e, R + M), to +T{e, R + M)] 

2 E<s<R+M '- -' 

(2.87) 
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It turns out from (2.86) and (2.87) that 

1 

E <y(t)<R + M - -(t -to-r) min p(s) (2.88) 

2 E<s<R+M 

for all te[to + r(s,R + M), to + T{e, R + M)]. 

Using (2.88) and taking into account definition (2.84) of T(-), we get e < 
y(tQ + T) <Q, which is a contradiction. This establishes (2.85). 

Implication (2.82), inequality (2.80), and property (2.85) guarantee that the fol- 
lowing attractivity property holds: 

For all (e, R, to, c) e (0, +oo) x di+ x di+ x [0, l],y e G(p, /x, c, to) 
v/ithy{to)<Randt>to + T{s,R + M) =^ 0<y{t)<s (2.89) 

We are now ready to establish that v{t) < 1 for all f > and limy^+oo 1^(0 — 
for the function v defined by (2.78). Since c > and /x(f ) > for all f > 0, it follows 
that the denominator in (2.78) is strictly positive and (2.77), (2.80) imply that v(t) < 
1 for all r > 0. Let e > 0, and let a :— a{s), b :— b{e) be a pair of constants with 
Q < a < b and being defined in such a way that jc ^ [a, ii] => J^ , < e. Then, 
by (2.77) and (2.80), it follows that 

y(t) 

— — -<e forallf >fo,3'eG(p,M,c, fo) 

g{y{to) + cj^^°^liis)ds) 

provided that either y{to) + c f, °° ii{s)ds <a ox y{to) + c f^ °^ fi{s)ds > b. 
It remains to consider the case a < yOo) + c f^ °^ fi(s)ds < b. By (2.89) we get 

^^ -<^<s for ei\lt> to +T{sg(a),b + M) (2.90) 

g{y(to) + cf+'^p(s)ds) g(a) 

It turns out from (2.78) and (2.90) that 

vit)<E for all t>T{sgia),b + M) (2.91) 

Since e > is arbitrary, (2.91) asserts that lim,^+oo v{t) — 0. The proof is thus 
complete. D 

The following comparison principle can be applied to lower semi-continuous 
functions and will be useful for the derivation of estimates of values of Lyapunov 
functional. 

Lemma 2.12 (Comparison principle) Consider the scalar differential equation 

w = f(t,w) 

(2.92) 
w{to) — wo 
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where fit, w) is continuous with 

(x-w)(f(t,x)- fit,w)) 



sup 



(t, x) e S,it,w) e S,x y^w] < +00 



for every compact S C iW"*" x J , where J C i1{ is an open interval. Let T > to be such 
that the unique solution wit) of the initial-value problem (2.92) exists and satisfies 
wit) e J for all t e [to, T). Let v : [to, T) — >• di be a lower semi-continuous function 
that satisfies the differential inequality 

, vit + h)-vit) , , 

D+i;(0:=linisup —<f[t,vit)) for all t e[to,T) (2.93) 

Suppose furthermore that 

vito) < wo (2.94) 

vit) e J forallte[to,T) (2.95) 

and that one of the following holds: 

(i) the mapping fit, ■) is nondecreasing on J C '!)\ for each fixed t e [to, T); 
(ii) there exists 4> e C''(S){"'") such that fit, w) < (pit) for all it, w) e [to, T) x /; 
(iii) the function v : [to, T) -^ Sit is right-continuous. 

Then vit) < wit) for all t e [to, T). 

Proof It suffices to show that vit) < wit) on any interval [fo, fi] C [to, T). Consider 
the scalar differential equation 

z^fit,z) + >~. 

(2.96) 
zito) = wo 

where 1 is a positive constant. 

Claim On any compact interval [to, t{\ C [to, T) and for every e > 0, there exists 
^ > such that ifO<\<8, then (2.96) has a unique solution z(t, X) defined on 
[to, t\\ and satisfies 

zit,X)eJ \zit,X.)-wit)\<e for all t e[to,ti] (2.97) 

Proof of Claim Since J C i)i is an open interval and [to, ?i] is compact, we can find 
p > such that if x e S){ with \x — w(f)| < P for some t e [to, ?i], then x e J . Let 
S :— [to, ?i] X [a,b], where a := min,g[,Q_f,] wit) — p andb :— maxteitoJi] wit) + p 
(notice that S c [to,h] x J), L := sup{ '-'-'~-''"'^|';-"^'~-^''--''" : (f,x) e S, it,y) e 

S,x ^ y} < +00, and X < S :— min{|, j}exp(— ^^^(?i — to))- Clearly, there ex- 
ists T e ito, ti] such that the solution of (2.96) exists for t e [to, r] and satisfies 
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(f, z(t, X)) e S for all t e [to, r]. Define v(t) :— \z(t, k) - w(f)P- Using the above 
definitions, we get v(t) < 2{L + l)v(t) + l} for all t e [fo, t], which directly im- 
plies that \z{t,X) — w{t)\ <lexp(^^(ri -ro)) for all f e [ro, r]. Using the fact that 



X <h:— min{|, ^}exp(— ^=yi(ri — fo)) and a standard contradiction argument, we 

' P.\ 

21 



can show that \z(t, k) — w(t)\ < min{|, f } for all t e [to, ti]. D 



Fact I v(t)<z(t,X),forallt e [to,ti). 

Proof of Fact I This fact is shown by contradiction. Suppose that there exists t e 
{to, ?i) such that v(t) — zit, X) > 0. For the lower semi-continuous function m(t) :— 
v{t) — zit, X), define the set 

A+:^{r e{to,ti):m(r)>0} (2.98) 

which by assumption is nonempty. The lower semi-continuity of m(t) :— v{t) — 
z{t,X) implies that A'^ is open. Let 

F:=inf{reA+} (2.99) 

Since A"*" is open, we conclude that t ^ A"*" or equivalently that v{t) < z(t, X). 
On the other hand, by definition (2.99) there exists a sequence {r, e A+l^j with 
r, —>■ t. Consequently, we obtain 

viti) - v{t) > z(ri,X) - z{t, X) (2.100) 

This implies 

D+v{t) > z{t, X) = f{t, z{t, X)) + X (2.101) 

We distinguish the following cases: 

(i) If the mapping f{t, ■) is nondecreasing on 7 C Sit, then the inequality 
v(t) < z(t,X) implies f(t,v{t)) < f(t,z(t,X)). The latter inequality, com- 
bined with (2.101), implies D'^v(t) > f(t, v{t)), which contradicts (2.93). 

(ii) If there exists a continuous function </> : [to, T) —^ di such that f{t, w) < 0(f) 
for all (t,w) e[to,T)x J, then we may define the lower semi-continuous func- 
tion v{t) = v{t) — f^ (p(s) ds. This function satisfies the following differential 
inequality: 

D+i{t) < D+v{t) - 4>(t) < f(t, v{t)) - (j){t) < 

Consequently, by virtue of Lemma 6.3 in [3], v(t) is nonincreasing. This im- 
plies that v{t + h) < v{t) for all h >0. Moreover, the lower semi-continuity 
of v(t) implies that for every e > 0, the inequality v{t + h) > v{t) — s for 
sufficiently small /z > 0. It follows that v{t) is a right-continuous function on 
[to, ti]. By virtue of the right-continuity and definition (2.99), we must also 
have v(t) > z(t,X). Thus we must have v(t) — z(t,X), and in this case by 
virtue of (2.101) we obtain D~^v(t) > fit, v(t)), which contradicts (2.93). 
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(iii) By virtue of the right-continuity of the function v : [Iq, T) -^ di and defini- 
tion (2.99), we must also have v(t) > z(t. A.). Thus we must have v(t) — z(t, X), 
andinthiscaseby virtue of (2.101) we obtain D~^v{t) > f(t, v{t)), which con- 
tradicts (2.93). D 

Factll vit) <w(t)forallt e{tQ,t\). 

Proof of Fact II Again, this claim may be shown by contradiction. Suppose that 
there exists a e (to, ti) with v(a) > w{a). Let e — ^iv(a) — w(a)) > 0. Further- 
more, let 1 > be selected in such a way that (2.97) is satisfied with this particular 
selection of e > 0. Then we obtain 

v{a) — v{a) — w(a) + w{a) — 2e + w(a) — zia, k) + z(a, k) > s + z(a, k) 

which contradicts Fact I. D 

Finally, notice that v(ti) — liminff^^i v{t) < liminfr^,j w{t) — w(ti) and con- 
sequently the inequality v{t) < w{t) holds for all t e [to,ti]. The proof is com- 
plete. D 

The following lemma exploits the results of the two previous lemmas and pro- 
vides a sharper estimate to a subclass of the differential inequalities considered in 
Lemma 2.11. 

Lemma 2.13 For every continuous positive definite function p : Di"*" — >• S)^"*" be- 
ing locally Lipschitz on S)i"'~\{0}, there exists a KL function a : (di'^) ~^ 'W"*" with 
a(s, 0) — s and -&(s, t) = —p{(j(s, t)) for all t, s >0 which satisfies the following 
property: 

(P) If ti > tQ > and y '■ [to, h] ~^ 9^^ '■J '^'^ absolutely continuous function that 
satisfies the following differential inequality for almost all t e [to, ft]: 

y(t)<-p{y(t)) (2.102) 

then the following estimate holds: 

y(t)<a{y{to),t-to) forallte[to,ti]. (2.103) 

Proof Consider the autonomous scalar differential equation 

wit)^-p{w(t)) 



w(to) — wo 



(2.104) 



where wq > 0. We will next show that the above initial-value problem admits a 
solution denoted by ^(t — to, wo) defined for all t > to which has the following 
properties: 
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1. either ^(f — rg, wq) > for all t > to, or there exists fmax > to such that ^(? — 
to, Wo) > for all t e [to, fmax) and ^(t - to, wq) = for all t > fmax, 

2. the function ct : (m+f -^ m+ defined by a(s, t) := ^(f , s) for all f > 0, 5 > 
and ct(0, t) :— for all r > is a KL function with ais, 0) — s and ^(s, t) — 
-p(a(s, t)) for all t, s > 0. 

Then property (P) is an immediate consequence of Lemma 2.12. Indeed, if 
y : [to, ?i] -^ di~^ is an absolutely continuous function that satisfies differential in- 
equality (2. 102) for almost all r e [fo,fi], wehave}'(r + /!) — y(t) + fl'^'' y(r)dr < 
y(t) — fi p(y(r))dr for all t e [to, ti) and h > sufficiently small. Therefore, 

we get D+y(t) := limsup;,^o+ ''■'+''1-''^'^ < -p(y(t)) for all t e [to, ?i). Apply- 
ing Lemma 2.12 with J :— (0, +oo) and T :— supjf e [to, fi] : y(t) > 0}, we get 
(2.103) for all t e [to, T) (notice that if ?niax < T, where fmax > ^o is the time with 
^(r - to, yito)) > for all t e [to, r^ax) and ^(t - to, yito)) = for all t > Wx, we 
obtain a contradiction, and consequently we must have ^max > T). If T < ri, by con- 
tinuity and monotonicity of y : [to, ?i] —^^ di~^ we obtain y(t) — for all t e [T, ti], 
which shows that (2.103) holds for all t e [to, fi). Finally, by the continuity and 
monotonicity of y : [to,ti] —^ iM"*" we obtain (2.103) for all t e [to,ti] and for the 
case y(to) — 0. 

The theory of ordinary differential equations and the fact that p : Dt"*" —^ S)}"*" is 
locally Lipschitz on J1{"'"\{0} guarantees that for all wq > 0, there exists f^ax > to 
such that the unique solution of (2.104) ^(t — to, wo) is defined for t e [to, ?max) 
and satisfies ^(t — to, wo) > for all t e [to, fmax)- By virtue of (2.104) it fol- 
lows that < ^(f — ro, wo) < w^o for all t e[to, fmax)- Consequently, if fmax < +oo, 
we have lim^^^- ^(t — to, wo) — 0. If fmax = +oo, then Lemma 2.1 1 implies that 
lim(^-i_oo ^(t — to. Wo) — 0. Notice that the theory of ordinary differential equations 
guarantees that for each fixed t e [to, ?max), the mapping wo^ ^{t — to, wo) is con- 
tinuous. Moreover, for each fixed wo > 0, the mapping [fo, fmax) ^ t —^ ^(t — to, wq) 
is nonincreasing. The solution is continuously extended by ^(f — fo, w^o) — for all 
t > ?max- Using the above properties, it can be shown that the function a : (iH"*")^ ^' 
91+ defined by (t(s, t) := ^(t, i) for all r > , i > and ct(0, t) := for all f > is 
continuous and nonincreasing in f > with limi^+Qca{s, t) — for all s >0. The 
reader should also notice that the equalities a(s, 0) — s and ^(s, t) — —p{G{s, t)) 
hold for all r.i' > 0. 

The only thing that remains to be shown is that the mapping di'^ 3 s ^ 
(r{s,t) is nondecreasing. Let si > S2 > arbitrary. Since ^(0,s\) — si > S2 
and \imt^+oo ^(t,si) — < S2, it follows that there exists unique t > such 
that ^{r,si) = S2- For every f > 0, the semigroup property implies ^(t,S2) — 
C,{t, C,{x, s^)) — C,(t + X, s\). The fact that the mapping Di"*" 3 t ^ ^{t, si) is non- 
increasing implies that ^(^,^2) — ^(t + t, ii) < i;{t,si). Therefore, the mapping 
Sit"*" 3 s ^^ ^(t,s) is nondecreasing; hence the mapping Dt"*" 3 s ^ a{s,t) is nonde- 
creasing. The proof is complete. D 

The following comparison lemma provides a "fading memory" estimate for an 
absolutely continuous mapping. 
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Lemma 2.14 For each C positive definite p : SH"*" — >• S)}"*", there exists a function a 
of class KL, with the following property: if y : [fo, t\\ —^ ?li'^ is an absolutely con- 
tinuous function, u : Di"*" — >• Dt"*" is a locally bounded mapping, and I C [to, ti] a set 
of Lebesgue measure zero such that y{t) is defined on [tQ,t\\\I and such that the 
following implication holds for all t e [fo, fi]\^: 

y{t)>u{t) ^ yi.t)<-p{y{t)) (2.105) 

then the following estimate holds for all t e [?o, t\\: 

y{t)<vaax\a{y{tQ),t -to), sup a(u{s),t - s)\ (2.106) 

Moreover, if p : ?){"*" — >• S)?"*" is locally Lipschitz on (0, +oo), then ct(.s', 0) — s, and 
^(s, t) = -p{a{s, t)) for all t,s>Q. 

Proof Notice that by virtue of Lemma 2.11, for each positive definite continuous 
function p : iU"*" -^ di~^, there exists a continuous function a of class KL with the 
following property: if y : [to, ti] —>■ Sit"*" is an absolutely continuous function and 
/ C [to, ti] a set of Lebesgue measure zero such that y{t) is defined on [to, ti]\I 
and such that the following differential inequality holds for all t e [to, ti]\I: 

y(t)<-p{y(t)) (2.107) 

then, the following estimate holds for all t e [to,ti]: 

yit)<cT{y(to),t-to) (2.108) 

Indeed, we may consider the absolutely continuous function y : J)?"*" -> di~^ defined 
as follows: 



• for the case y(ti) > 0, y(t) — yit) for t e [to,ti], y{t) — y{ti) - 



(t - ti)maxo<u,<y(„)p(w) for f e [ti,ti + hs^^^^So^w]' ^"'^ ^^^^ " ^ ^°^ 



t > ti + - , , , 

• for the case y(ti) — 0, y{t) — y(t) for t e [to, t[], and y(t) — OioTt>ti. 

The reader may verify that y : di~^ —>■ di~^ is an absolutely continuous function 
which satisfies jfy(t) < —p{y(t)) for almost all t > to- Lemma 2.11 applied for 
y : [to, +oo) -^ ;H+ implies (2.108) for all t e [to, fi]. 

Notice that we may continuously extend a by defining a{s,t) :— a(s, 0) exp(— r) 
for r < 0. Moreover, notice that Lemma 2.13 guarantees that a'(s,Q) — s and 
^{s, t) — -p{a{s, t)) for all t,s >0, provided that p : i)i+ -^ 9t+ is locally Lips- 
chitz on (0, +oo). 

Clearly, (2.106) holds for t — to and ct the function involved in (2.108). We next 
show that (2.106) holds for arbitrary t e (to,ti]. 
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Let arbitrary t e (?o> ?i] and define tlie functions 

IM(r) Vre[ro,?] 
u(r) :— limsupM(§) 
otherwise ^^t 

Notice that u is upper semi-continuous on r e [Iq, t], and consequently the function 
p{r) :— y(r) — u(r) is lower semi-continuous on [to, t]. Next define the set 

^:={re[ro,f]:y(T)<M(r)} (2.109) 

We distinguish the following cases: 

(1) yl = 0. In this case we have ^(t) > u(r) for all r e [to, t]. Since m(t) > m(t) 
for all r e [to, t], the previous inequality, in conjunction with (2.105), implies 
that ^(t) < — ^(^(r)) for all r e [to, t]\I . Thus in this case Lemma 2.11 (or 
Lemma 2.13) guarantees that estimate (2.108) holds. 

(2) yl ^ and § :— sup A < r. In this case there exists a sequence r, < ^ with r, -^ 
f and yiti) — m(t/) < 0. Since the function p(t) — y(t) — u(t) is lower semi- 
continuous, we obtain p{^) — liminf^^j p(r) < 0, and consequently y(^) < 
m(§). Moreover, notice that by definition (2. 109), implication (2.105), and since 
u{r) > u(r) for all r e [to, t], the differential inequality y{r) < —p(y(r)) holds 
for allr e {^,t]\I . Consequently, Lemma 2.11 (or Lemma 2.13) implies y(t) < 
a(y(r), t — r) for all r e (f , f]. By virtue of the continuity of a and y, we get 

yit)<cy[y(^),t-^) 

which, combined with y(^) <u{^), directly implies 

y{t)<a{u{^),t -^)< sn^ a{u{s),t-s) (2.110) 

tQ<S<t 

(3) yl ^ and ^ :— sup yl = r. In this case there exists a sequence t,- < t with r,- -^ t 
and yiti) — m(t,) < 0. Since the function p{t) — y{t) — u{t) is lower semi- 
continuous, we obtain p{t) — liminf^^f /5(t) < 0, and consequently y(t) < 
u(t). Moreover, since g(s, 0) > s for all i > 0, it holds that 

y{t) <u{t) <G{u{t),0) < sup a[u{s),t - s) 

to<s<t 

Combining all the above cases, we may conclude that 

y(t) <max\a[yito),t -to), sup (j(u{s),t - s)\ (2.111) 

^ to<s<t > 

Let M :— sup, <,<, u(s). For each e > 0, there exists ^ > such that a{s,r — S) — 
(t(s, t) < e for all (s, r) e [0, M] x [0, t]. Notice that since 

Im(t) 'it e[to,t] 
otherwise 
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it follows that M (j) < sup{u(r) : inax(s — S, to) < r < min{s + S, t)} for alii e [Iq, t]. 
The previous inequalities imply that 

<t[u(s), t — s) < sup{cr(M(r), t — s) : max(s — S,to) < r < min(s + 8, f)} 

< sup{cr(M(r), t — r — S) : max(i — S,to) < r < min(s + S, f)} 

< sup{cr(M(r), r — r) : max(i — S,t()) < r < min(s + S, f)} + s 

< sup a(^u{r),t — r) + s 

to<r<t 

The above inequality, in conjunction with (2.111), implies that for each s > 0, it 
holds that 

yit) <max\ij[y{to),t -to), sup (j(u(s),t - s)\ + s 

' to<s<t ' 

Since e > is arbitrary, we conclude that the above estimate directly implies 
(2.106). The proof is complete. D 

Lemma 2.15 For every pair of functions p : DJ"*" — >• DJ"*" being locally Lipschitz and 
positive definite and /i being of class £ with ii(t) > Ofor all f > 0, there exists a KL 
function a : (Dt"*") — >• Dt"*" which satisfies the following property: 

(P) If c e [0, 1] is a constant, ?o > 0, y € K^ with f^ °° y{t)dt — +oo, and y : 
[to, ti] -^ M"*" is an absolutely continuous function that satisfies the following 
differential inequality for almost all t e [fo, ?i]: 

y(t)<-y(t)piy(t)) + cy(t)Jj y(s)ds^ (2.112) 

then the following estimate holds for all t e [to, fi]: 

yit)<a(yito) + cJ J J y{w)dw\Y{s)ds, j Yis)ds\ (2.113) 



Proof Let (/>(f, to, yo) denote the solution of the scalar differential equation 

(2.114) 



y{t) = -Y(t)p{y(t)) + cY{t)iii / K(r)fifi 



y{to)^yo^'d^ 

where p{y) :— p{y) for y > and p(y) :— for y < 0. Notice that p :di ^ di~^ is a 
locally Lipschitz function which coincides with p : di~^ —>■ di~^ on di~^. By perform- 
ing the time-scaling t — Jq y(s) ds it is clear that 



</„''""*-f 



(pit,to,yo)^d y{s)ds, y(s)ds,yo] (2.115) 
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where ^(t, tq, yo) denotes the solution of the scalar differential equation 

d , , 

-j-yM = -p{yiT:)) +cii{r) 
dr (2.116) 

y(ro)^yoedi 

Using a contradiction argument, it can be shown that ^(r, tq, yo) exists for all r > to 
and f (r, to, yo) > for all t > tq if yo > 0. Moreover, Lemma 2.1 1 (applied to the 
absolutely continuous function ^(r) :— ^(r, tq, 3'o), yo > 0) implies that there exists 
a KL function a : (Si"*")" -^ ^H"*" such that the following estimate holds for all yo > 0: 



-K^° + ^/o 



-+00 

< ^(r. To, yo) < cr( yo + c / ix{s)ds, r — To] for all r > to (2.117) 



It follows from (2.115) and (2.1 17) that the solution 0(f, to, yo) with yo > satisfies 
the following estimate: for all ? e [fo, ^i], 

O<0(f,fo,yo) <cr(yo + c / /li Yiw)dw\yis)ds, Yis)ds\ 

(2.118) 
By applying Lemma 2.12 with f{t,y) — —y(t)p(y) + cy{t)fji(fQ y(r)dr) and 
/ :— (—a, +cxd), where a > and T :— ti, we obtain, for all t e [to, ti], 

0<y(t)<(t>(t,to,yQ) (2.119) 

The conclusion of the lemma follows by combining inequalities (2.1 18) and (2.1 19). 
The proof is complete. D 

Remark 2.4 It should be noted that if p : di~^ -^ di~^ is a continuous positive definite 
function, then there exists p : Di"*" -^ di~^ which is globally Lipschitz on Dt"*" with 
unit Lipschitz constant and positive definite, and satisfies < p(s) < p{s) for all 
s > 0. Indeed, we may define p(s) :— inf{p(y) + \y — s\; y > 0}, which is globally 
Lipschitz on ?){"'" with unit Lipschitz constant. To see this, first notice that p{s) :— 
min{p(y) + ly — i|; < y < s + p{s)} for all s >0. Let si, ^2 > with p(si) :— 
P(yi) + |yi — ■Si I and notice that 

pfe) <p(yi) + |yi -S2\ <p(yi) + |yi -.sil + ki -^2! = /o(si) + \si - S2\ 

Consequently, Lemma 2.13 guarantees that for every continuous positive definite 
function p:di+ ->■ di+, there exists a KL function a : (S1{+)^ ->■ di+ with ct(s, 0) = s 
for all i' > which satisfies Property (P) of Lemma 2.13. Moreover, Lemma 2.14 
guarantees that for each C*' positive definite function p : fit"'" -^ fit"*", there exists 
a function a of class KL with cr(s, 0) — s for all s > 0, satisfying the property 
described in the statement of Lemma 2.14. 
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2.6 Lyapunov Functionals 

One of the most important tools for establishing RGAOS for a control system is 
the method of Lyapunov functionals. Lyapunov functionals are, roughly speaking, 
nonnegative functionals of the state of the control system which tend to as f — >• 

+00. 

The following theorem shows that the existence of a Lyapunov functional is a 
sufficient condition for RGAOS for systems that satisfy the following additional 
hypothesis: 

(HYP) There exists a constant r > 0, a bounded positive continuous function 
/i : S1{+ X 9J+ -^ (0, r], and a partition jt = {T/l^o of '^^"^ ^'^h that for every 
{to,xo, d) e di~^ X X X Mu, it holds that 7r(ro,xo, UQ,d)n {b{t{), \\xq\\x), to + r]^^ 
0, where b{t, p) :— min{q„(t), t + hit, p)]. 

Remark 2.5 It is worth noting the following. 

1. Hypothesis (HYP) holds for many classes of systems including systems de- 
scribed by ordinary differential equations, systems with variable sampling parti- 
tion, and systems described by retarded functional differential equations. 

2. Hypothesis (HYP) guarantees the existence of r e (fo>?o + '"] such that r e 
7t{tQ,XQ,UQ,d) for all {ta,x{),d) e di~^ x X x Mo- Thus, for all (to,xo,d) e 
Dt"*" X X X Mq, it follows that the set 7r(ro, xq, uq, d) fl (fg, +oo) cannot be empty. 

Theorem 2.3 (Lyapunov functionals) Let E :— (X,y,Mu,MD,(t>,yt,H) be a 
control system with outputs satisfying Hypothesis (HYP) and the BIC property. 
Assume that Q & X is a robust equilibrium point for E . Suppose that there exist 
mappings V : 9{+ x A:" ^ ;«+, yS, y, /x e K+ with f^"^ Y{t)dt = -|-oo, (p e £, 
ai,fl2 € Koc, and a locally Lipschitz positive definite function p : !){"*" — >• Dt"*" 
such that for every (to, xq, d) e iW"*" x X x Md, there exists x e Tt(tQ, xq, mq, d) fl 
[6(fo, II-'^oIIa'): ^0 + '■]> where b(t,p) :— mm{q„(t),t + h{t,p)} is the function 
in (HYP), with (r, to, xq, uq, d) e A^ and the following properties: 

ai(||//(f,(/)(f, to,xo, uo,d), 0)||-y + fi(t)\\(f>(t , to, XQ, UQ, d)\\ ^) 

<Vito,xo)<a2{P(to)\\xQ\\x) forallte[to,r] (2.120) 

V{r, (Pit, to, xo, MO, d)) < r]{T, to, V(to, xo)) (2.121) 

where rj{t,to, r)o) denotes the unique solution of the initial-value problem 



/: 



i]^-Y(t)piri) + Y{t)(p[ / Y(s)ds\ rj(to)^m>0 (2.122) 



Then, E is RGAOS. Particularly, if(p(t) = 0, y{t) = I and if for every (to, xo, d) E 
Ot"*" X A" X Mo, we have, in addition, ai{\\H{t,(p{t,to,xo,uo,d),0)\\y) < 
V(to,xo) < aidkollA") for all t e [to,r], with r e 7T(to,xo,uo,d) fl [b(to, 
ll-^oll A"); (q + '"] fhe time for which (2.120) and (2.121) hold, then E is URGAOS. 
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Proof By virtue of Lemma 2.1, it suffices to show that U :— {X, y, Mjj, Mo, 
4>,7t, H) is RFC and satisfies the Robust Output Attractivity Property (Property P3 
of Definition 2.2). Notice that Lemma 2.15 implies that there exist a function 
a(-) e KL and a constant M > such that the following inequalities are satisfied 
for all to>0: 

< ri{t, to, r]o) <a[r]o + M, q{t, to)), for all t > to, for all jjo > (2.123) 

where q{t, to) :— f^ y{s)ds. Furthermore, if q){t) = 0, y(t) = 1, it follows from 
Lemma 2.11 that there exists ct() e KL such that the following inequalities are 
satisfied for all to > 0: 

< riit, to, r]o) < a{r]Q, t - to) for all t > to, for all /70 > (2.124) 

Pick arbitrary {to,xo,d) e di~^ x X x Mo and let to — to. We consider the 
sequence x,- = 0(t;, t/_i,x,_i, mq, ^)> ' >; 1, and t; e 7T(r,_i,x,_i, mq, c?) H 
[6(r/_i, ||x/_i 11;^'), T,_i + r], i > 1, for which (2.121) holds with (r,_i,x/_i) in 
place of (to, xo). By virtue of the weak semigroup property (Property 4 of Defi- 
nition 1.1), we have r,- e 7r{to, xo, uo, d), r,- < To + "" and x,- — (p{xi, to, xo, mq, d) 
for all i > 1. The semigroup property for r]{t,to, rjo), in conjunction with inequal- 
ity (2.120) and trivial induction arguments, implies that 

ai(\\H[t,(p(t, to, xo, uo,d),0)\\y + fj,(t) \\(p{t, to, xo, mo, d) \\.^) 

< V(r,_i,x,_i) < ri{ri-i,to, V(to,xo)) V/ > 1, f e [t,_i, r,] (2.125) 

Combining (2.123) with (2.125) and using the fact that maxjro, t — r] < r,_i for 
t e [t,_i, r,], (■ > 1, we obtain, for all / > 1 and t e [to, t,], 

fli( II //(?,(/)(?, to,xo, uo,d),0)\\y + n(t)\\(j)(t , to, Xo, uq, d)\\ ^) 

<cj{a2{fi(to)\\xo\\x) + M,q{miix{to,t - r},to)) (2.126) 

which directly implies 

ai (II //(f , (/)(f , to, xo, uo, d), 0) ||-y + fJ.it) ||0(f , to, xo, MO, d) \\^) 

<(T(a2(y6(fo)||xo||;t') + M,0) foralli > 1 andre [fo,r,] (2.127) 

We next show that (t, to, xo, uo, d) e A^ for all t > to- By virtue of estimate (2.127) 
and the BIC property, it suffices to show that r, -^ +00. Let arbitrary T > 0. Since 

the set [0, T + r]x [0, e] is compact, where s := "" "t^^^'^S^^^^ ''^^ and h is 
continuous, we have i' :— mm{h(t, p); (t, p) e[0,T + r]x [0, e]} > 0. Consider the 
infinite sequence {yi}°°^o which satisfies yz+i = min{^;,r(3';), v/ + s], i — 1,2, . . ., 
with yo = 0. By virtue of a standard contradiction argument we can show that y, -^ 
+00 (as in the proof of the Claim in Sect. 1.2.5), and consequently for every T > 0, 
there exists an integer N > such that y]\i > T + r. Clearly, the sequence {t,}^q 
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satisfies r, _|_ i > imn{q„ (r, ) , r, + 5 } for all integers / for which r, < T + r.By virtue 
of Theorem 1.6.1 in [34] (Comparison principle) we have t,- > j, for all integers i 
for which xi <T + r, which implies r^ > T . 

It follows that estimates (2.126) and (2.127) hold for all t > Iq. Robust Forward 
Completeness is an immediate consequence of (2.127), and the Robust Output At- 
tractivity Property (Property P3 of Definition 2.2) is an immediate consequence of 
estimate (2.126). 

Notice that if ip(r) = 0,y(t) = l, and if for every (tQ,XQ,d) e ;H+ x X x Md,^& 
have, in addition, that ai(\\H{t,(f){t, tQ,XQ,UQ,d),Q)\\y) < V(to,XQ) < fl2(lkollA') 
for all t e [to, r], then using (2.124) instead of (2.123), we obtain, in addition, the 
following estimate for all t >to: 

ai{\\H{t,(p(t, tQ, XQ, Mo, d), 0) \\y) < cr (a2(lkollA'), max{0, t-tQ- r}) 

The above estimate directly implies that Z is URGAOS. The proof is complete. D 

Theorem 2.3 is a general theorem that can be applied to all deterministic systems 
of Definition 1.1 which satisfy property (HYP). However, the reader should note that 
inequalities (2.120), (2.121) are prerequisites for the application of Theorem 2.3 
and they must be shown by using another result. Notice that inequalities (2.120) 
and (2. 121) require a substantial amount of knowledge of the transition map of the 
control system, which is usually not available. This is a serious disadvantage of the 
method. 

There are two ways to overcome the above disadvantage for systems which sat- 
isfy the classical semigroup property: 

(1) Lyapunov's approach 

(2) The "discretization approach" 

Next, we describe the two approaches in an informal way. 

(1) Lyapunov's approach 

For systems which satisfy the classical semigroup property, the above disadvantage 
can be overcome in an elegant way: we let the constant r > Q involved in Hypoth- 
esis (HYP) to become sufficiently small. Then inequality (2.121) becomes a differ- 
ential inequality, 

V{r,(l)(r,to,xo,uo,d)) - V(to,xo) < r]{r,to, V(to,xo)) - V(to,xo) 

V(to + h,(p(to + h, to, XQ, MO, d)) - V{tQ, xq) 
lim sup 

r](tQ + h,tQ,V{tQ,XQ))-V(to,xo) 
< lim sup 



h^0+ h 



which implies 
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V(to + h, ((>(to + h, to, xq, uq, d)) - V(to,Xo) 



limsup 



-y(to)piV{to,XQ)) + y(to)<p( / y(s)ds 



Notice that an upper bound for the quantity 

V(to + h,(p(to + h, to, XQ, UQ, d)) - V{tQ, xq) 
hm sup 

can (usually) be computed without knowledge of the transition map (j){x,tQ,XQ, 
UQ,d) of the control system U :— (X,y,Mu,Mj),(t),n,H). Moreover, letting 
r > to become arbitrarily small and assuming continuity with respect to time of 
the transition map (f)(x, to, xq, mq, d), inequality (2.120) requires no knowledge of 
the transition map: 

ai{\H(tQ,XQ,Q)\y + ii{tQ)\\xQ\\x) <V{tQ,XQ) <a2{P{tQ)\\xo\\x) 

The above thoughts lead us to the production of specialized results for two kinds 
of systems of Definition 1.1, systems described by ODEs and systems described by 
RFDEs. 

(2) The "discretization approach" 

The idea in this approach is that we examine the value of the Lyapunov functional 
only at discrete time instances. For the sequence of the chosen time instances, we 
can show that the Lyapunov functional decreases in value. However, we do not 
demand an explicit knowledge of the time instances, and we do not require that the 
difference between two consecutive time instances must be bounded (by r). 

The discretization approach has been developed mostly for systems described by 
ODEs and has been applied successfully for the solution of difficult control prob- 
lems. We will present specialized results for systems described by ODEs. However, 
the method can be applied to various systems which satisfy the classical semigroup 
property. 

Due to the close relation of the discretization approach to the stability analy- 
sis of discrete-time systems, we will describe the method in the section devoted to 
discrete-time systems below. Here we describe Lyapunov's approach. 



2.6.1 Control Systems Described by Ordinary Differential 
Equations 

We start by presenting a general Lyapunov theorem for systems described by ODEs 
of the form (1.3) under Hypotheses (Hl-4). 
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Let V : di'^ X di" —^ SH"*" be a locally bounded function. We define the following 
generalized Dini derivative for all (t, x) e iH"*" x !1{", v e Df : 

n V(t + h,x + hv)-V(t,x) 
V°(t,x;v):^\imsup ^^— - (2.128) 

Notice that if V : Dt"*" x SW" ^^ iW"*" is locally Lipschitz, then the above derivative 
is locally bounded. 

Theorem 2.4 Consider system (1.3) under Hypotheses (Hl-4) and suppose that it 
is RFC. Furthermore, suppose that there exist functions V : Di"*" x di" — >• SH"*" being 
locally Lipschitz, /S, y e K'^ with f^ °^ y(t)dt — +oo, (p e £, ai,a2 € Koo, and 
a locally Lipschitz positive definite function p : Sit"*" — >• ilt"*" such that the following 
inequalities hold: 

ai{\H{t,x,Q)\)<V{t,x)<a2{Pit)\x\) for all (t , x) e m+ x m" (2.129) 
V°{t,x; f(t,x,0,d))<-Y(t)p{V(t,x)) + y(t)(p( j y(s)ds 

for all (t,x,d)em+ X m" X D (2.130) 

Then system (1.3) is RGAOS. Particularly, if fit) = 0, y{t) = 1, and /S(f) = 1, 
then (1.3) is URGAOS. Moreover, if there exist functions a G Kqq, jjl e A""*", and a 
constant R>0 such that a(fi(t)\x\) < V(t,x) + R for all (t,x) e dl'^ x dl" , then 
the requirement that (1.3) is RFC is not needed. 

Proof By Lemma 2.1, it suffices to show that (1.3) is RFC and satisfies the Robust 
Output Attractivity Property (Property P3 of Definition 2.2). 

Consider a solution x{t) of (1.3) under Hypotheses (Hl^) corresponding to ar- 
bitrary d e Mo with initial condition x(to) — xq e di". Clearly, the solution exists 
for t e[to, fmax), where /max e {to, +oo] is the maximal existence time of the solu- 
tion. Notice that the mapping t —>■ V(t, x{t)) is absolutely continuous on [to, fmax), 
and we have 

-V{t,x(t))^V°{t,xity,f{t,x(t),0,d(t))) a.e. on [ro, fmax) (2.131) 

where V°(t, x; v) := limsup;,^o+ ^(^+^-^+^")-''('-^) . Indeed, notice that for all t e 
[to , fmax) \ t , where I C[to, ?max) is the set of zero Lebesgue measure such that either 
^Vit,x(t)) is not defined on /, or Z)+jc(f) :— limij^o+ h~^(xit + h) - x(t)) / 
f(t, x(t), 0, d(t)), we get, for sufficiently small h > and any t e [to, fmax)\^, 

x(t + h)-x(t)-hD+x{t)^hyh (2.132) 

where 

x(t + h)-x(t) 

yh = ; D^x{t) 

h 
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Since lim/,^o+ ■'■"^^+^^~-''^^' = D+x(0, we obtain that y,, -^ as h ^ 0+. Since 
V : Di"*" X 9{" —^ di'^ is locally Lipschitz, we have 

„0/, ,,, n+ r,^\ v Vjt + h,x(t) + hD+x(t)) - V(t,x(t)) 
V (t,x{t); D^x(t)} — limsup 

V{t + h, x{t) + hD+x{t) + hyh) - V{t,x(t)) 
— lim sup 

The above equality, in conjunction with (2.132) and the facts that jjV{t,x(t)) — 
limsup;,^o+ v('+f',-^(t+h))-v(t,x(t)) ^^^ D+x{t) = f{t,x(t),0,d(t)) for all t e 
[to, tmAx)V, implies (2.131). 

It follows from Lemma 2.15 and inequalities (2.130) and (2.131) that there exist 
a e KL and a constant M > such that 

V{t,x{t))<aiv(tQ,XQ) + M, I Yis)ds\ for all f e [fo, ^max) (2.133) 

Next, we distinguish the following cases: 

1. If (1.3) is RFC, then (2.133) holds for all t > t^, then the Robust Output At- 
tractivity Property (Property P3 of Definition 2.2) is a direct consequence of 
inequalities (2.129) and (2.133) and from the fact that /q °° Y{t)dt — +oo. 

2. If there exist functions a e Kqc, /x e K'^ and a constant R > such that 
fl(M(Okl) < V{t, x) + R for all (t, x) e J){+ x 9i", then (2.133), in conjunction 
with (2.129), implies the following estimate: 

\x(t)\<—a-^{R + a{a2{fiitQ)\xo\)+M,Q)) for allf e [ro, Wx). (2.134) 

Estimate (2.134), in conjunction with the BIC property, implies that fmax — +oo. 
Moreover, estimate (2.134), in conjunction with Definition 2.1, shows that sys- 
tem (1.3) is RFC, since we have, for all r,T >0, 

sup{|jt:(fo + s)|; 5 e [0, T], \xo\ <r,toe [0, T],d e Md] 

_ ^(R + a(a2(rm&\^{t)\+M,Q]) <+oo 
mino</<2rM(0 ^ ^ ^o<t<T / // 



' -o-'- 



The proof is complete. D 

Remark2.6 If for all (x , cf) e S)f' x D, the mapping f ^^ /(f,x, 0, J) is continuous, 
then inequality (2.130) is equivalent to the following inequality: 



dV dV 

— (t,x) + - 

9f a 



^{t,x)f(t,x,Q,d)<-Y{t)p{V{t,x)) + Yit)Jj Yis)ds\ 



(2.135) 
for almost all {t,x) e 9t+ x i)i" and all c/ e Z). 
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Indeed, using Corollary 8.2 in [11] (p. 95), we have, for all v e f){" and (r, x) e 

d\+ X m", 

V(r + h,y + hv)- V(r,y) 
lim sup 



lim sup 

{T,y)^{t,x) 



\dV dV 

at ax 



where Qy C S)}"*" x di" is the zero Lebesgue measure set such that V : 9{"'" x fli" -^ 
di~^ is not differentiable on Qy, and f2 C di~^ x !1{" is an arbitrary set of zero 
Lebesgue measure. Taking v — f(t,x,0,d) and using the facts that |y(r, y) 
is bounded in a neighborhood of (t,x) e S)}"*" x M" and that f{r,y,0,d) -^ 
f(t, X, 0, d) for (r, y) -^ (t, x), we get 

V(r + /z, y + /z/(r, X, 0, cf)) - V(r, y) 
lim sup 



lim sup 

(r,y)^(f,x) 



9y dv 

l^(r, y) + — (r, y)f(r, y, 0, af) : (t, y) ^ fi U f2v 
at ax 



The above equality, together with (2.135), implies that, for all (t,x) e !!{"'" x di", 
deD, 

V(r + h,y + hf(t, X, 0, d)) - V(r, y) 
lim sup 

h^O+.(T,y)^(t,x) ^ 

<-y(t)p{V(t,x)) + y(t)<p( y(s)ds 

By means of the fact that 

vor, fr. n ^^^ ^ r V(r + h,y + hf(t,x,0,d)) - V(r,y) 
V [t,x,; f{t,x,0,d)) < limsup 

h^O+.(T.y)^(t,x) " 

(2.130) follows readily. 



2.6.2 Control Systems Described by Retarded Functional 
Differential Equations, RFDEs 

We continue by presenting a general Lyapunov theorem for systems described by 
RPDEs of the form (1.10) under Hypotheses (Sl-4). The reader may think that all 
arguments presented for the case of ODEs can be repeated in this case as well. This 
is not true. There are many technical complications arising for systems described by 
RFDEs. The following list presents some complications: 
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1 . the mapping t —> V(t,Tf (t)x) is not absolutely continuous, even if the functional 
V : di'^ X C*'([— r, 0]; JH") -^ fff^ is completely locally Lipschitz (or even if it is 
Frechet differentiable), 

2. it may not be required that the Lyapunov functional bounds a certain function of 
the norm of the output. 

We next show how all the above complications can be overcome. An important 
class of functionals is presented next. 

Definition 2.4 We say that a continuous functional V : Dt"*" x C^([—r,0]; 
9f' ) -^ 5)^+ is "almost Lipschitz on bounded sets" if there exist nondecreasing func- 
tions M ■.di+ ^di+, P : di+ -^di+, and G ■.di+ ^ [I, +oo) such that for all 
R>0, the following properties hold: 

(PI) Foreveryx,ye{xeC^([-r,0];m"); \\x\\r </?}, it holds that 

\V{t,y)-V{t,x)\ <M(R)\\y-x\\r for all f e [0, /?]. 

(P2) For every absolutely continuous function x : [— r, 0] —>■ di" with ||x ||;- < R and 
essentially bounded derivative, it holds that 



\V(t + h,x)-V(t,x)\<hP(R)(l+ sup |i(r)|) 
for all t e [0, R]andO<h< 



-r<T<Q 
1 



G(/? + sup_^<^<o|i(r)|) 

Let X e C^(,[-r, 0]; 9i"). By Ehix; v), where <h < r and v e di", we denote 
the following operator: 

\x(0) + {e + h)v foi-h<e<0 
Eh(x;v):^ i v y v . _ (2.136) 

\x{e + h) for -r<e<-h 

For mappings V : M+ x C*'([— r, 0]; 9t") -^ 9t that are almost Lipschitz on bounded 
sets, we will use the following Dini derivative defined for all {t,x,v) e di~^ x 
C°{[-r,Q];di") X di": 

,,0. , y V{t + h,Eh{x;v))-V{t,x) 
y (f, x\ v) :— limsup 



/i^0+ 



h 



The reason for introducing the above derivative becomes apparent by the following 
lemma. 

Lemma 2.16 Let V : Ot+ x C°([-r, 0]; SH") -^ SH be an almost Lipschitz on 
bounded sets functional, and let x € C ([fo — '', fmax); ^") be a solution 0/(1.10) 
under Hypotheses (Sl^) corresponding to certain (d,u) € Md x Mu, where 
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fjiiax £ (^0' +oo] is the maximal existence time of the solution. Then it holds that 

limsup/i"^ (y (r + h, T^it + h)x) - V{t, T,{t)x)) < y°(r, Tr(t)x; D+x{t)) 

(2.137) 
for almost all t e [fg, fmax)^ where D~^x(t) — lim/,^o+ h~ {x{t + h) — x(t)). 

Proof It suffices to show that (2.137) holds for all t e [fo> ^max)\^. where / C 
[to, ^max) is the set ofzeroLebesgue measure such that Z)"'"x(f) — lim/,^o+ h~^(x(t + 
h) — x{t)) is not defined on /. Let h >Q and t e [to, fmax)\^- We define 



Tr(t + h)x - Eh{Tr(t)x; D+x(t)) = hyn 



(2.138) 



where 



yh = h~ 



x{t + h + e)- x(t) -{6 + h)D+x(t) for-h<e<0 







for -r <6 <-h 



and notice that yh e C*'([— r, 0]; Sit") (as a difference of continuous functions, 
see (2.138) above). Equivalently, y/, satisfies 



' e+h (x(t+e+h)-x(t) 



yh 



i±h( 

h \ 



e+h 



D+x{t)) for-h<e<0 
for -r <9 <-h 



with 



II Ml 



: sup 



x(t + s) - x(t) 



D+xit) 



■0<s<h\. 



Since limft^o+ ''^''^''l '"'^'^ = D+x(t), we obtain that v/, ^ as /z ^ 0+. Since V : 
Sli"*" X C*'([— r, 0]; SR") -^ di is almost Lipschitz on bounded sets and since y/, -^ 
as /i ^ 0+, it follows that 

limsup/!"'(y(r + /!,£,,(7;(r)x; D+x(t))+hyh) - V(t,Tr{t)x)) 

h^0+ 

= V°{t,Tr(t)x;D+x(t)) 
Moreover, definition (2.138) and the above equality imply 
limsup/!"^(y (f + h, Trit + h)x) - V{t, Tr(t)x)) 

h^0+ 

^limsuph~^ {V {t + h, Eh{Tr{t)x; D+x(t))+hyh) - V{t,Tr(t)x)) 

h^0+ 

^V°{t,Tr(t)x;D+x(t)) 
The proof is complete. D 
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The reason for introducing the class of almost Lipschitz on bounded sets func- 
tionals is the following result, which shows that the mapping t —>■ V(t, Tr(t)x) is 
absolutely continuous for a special class of initial conditions. 

Lemma 2.17 Let V : Ot"*" x C^{[—r, 0]; JR") -^ 'Si be afunctional which is almost 
Lipschitz on bounded sets, and let x e C^([to — r, rmax); Si") be a solution o/(1.10) 
under Hypotheses (Sl-4) corresponding to certain (d, u) e Md x Mu with initial 
condition Tr{tQ)x — xq e. C ([— r, 0]; S\"), where t^ax G (fo> +od\ is the maximal 
existence time of the solution. Then for every T e (Iq, fmax), the mapping [Iq, T] 3 
t -^ V{t, Tr(t)x) is absolutely continuous. 

Proof It suffices to show that for all T e (Iq, fmax) and s > 0, there exists 5 > such 
that ^^_j \V{bk, Tr(bii)x) — Viaic, Tr(ak)x)\ < s for every finite collection of pair- 
wise disjoint intervals [a^, bk] C [to, T] (k — I, . . . , N) with "^i^^iibk — a^) < 8. 
Let T e (to, fmax) and e > (arbitrary). Since the solution x e C''([fo - r, T]; i)i") 
of (1.10) under Hypotheses (Sl^) corresponding to certain (d,u) e Mo x Mfj 
with initial condition Tr{to)x — xo € C^([—r,0]; Si") is bounded on [to — r,T], 
there exists Ri > such that sup,g<^<7- ||rr(T)x||r < Ri. Moreover, by Hypothe- 
sis (S2) and since Ty(to)x — xo € C'([— r, 0]; Si"), there exists R2 > such that 
sup, ^r<^<7- \x(r)\ < Rj. The previous observations, in conjunction with prop- 
erties (P1)-(P2) of Definition 2.4 imply, for every interval [a,b] C [to, T] with 
b-a< ' 



< 



G(Ri+R2)' 

\v{b,Tr(b)x) - V{a,Tr(a)x)\ 

<{b- a)P(/?i)(l + R2) + M{Ri)\Tr{b)x - Tr{a)x\^ 

In addition, the estimate sup^^j _,.<,.< 7- |i(r)| < R2 implies \\Tr(b)x — Tria)x\ 
(b — a)R2 for every interval [a,b] C [to, T]. Consequently, we obtain, for every 
interval [a, b] C [to, T] with b — a < tjtrtt^; 

\v{b, Tr{b)x) - V{a, Tr{a)x) \<{b- a)[P{Rx){\ + R2) + M{Ri)R2\ 

The previous inequality implies that for every finite collection of pairwise dis- 
joint intervals [ak, bk\ C [to, T] (k — 1, . . . , N) with "^/c^iibk — ak) < &, where 
^ = 2 min{ G(^^; P(Roa+Rl)+M(R,)R2 ^ > 0' it holds that 

N 

'^\V{bk, T,.{bk)x) - V{ak, T,.{ak)x)\ < s. 
k=\ 

The proof is complete. D 

The following technical lemma shows that, without loss of generality, we can 
restrict our attention to continuously differentiable initial conditions. 
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Lemma 2.18 Consider system (1.3) under Hypotheses (Sl-4) and suppose that 

there exist mappings fii : di+ x C°([-r, 0]; D^) -^ di and P2 ■ ^^'^ x J){+ x 
C°([— r, 0]; i)i") X A ^ S){, where A C Mq x My, with the following properties: 

(i) /or eac/i (t,to,d,u) e dl~^ x Di"*" x A, the mappings x — )► Pi{t,x), x -^ 

P2{Uto,x,d,u) are continuous, 
(ii) there exists a continuous function M : Jli"*" x Jli"*" — >■ M"*" ^Mc/i that 

sup{/S2(fo + ?, ?o, xo, d, u); sup|m(t)| <s,^e [0, T], xq e C^{[-r, 0]; *){"), 

Ikollr < J, fo e [0, r], (J, m) e a| < M{T, s), 

(iii) /or ever}' (?o, xq, (i, m) G ;)i+ x CH[-r, 0]; i)f' ) x A, the solution x(t) o/(1.10) 
with initial condition Tr(tQ)x — xq corresponding to input (d, u) e A satisfies 

Pi{t,Tr(t)x)<P2it,to,XQ,d,u) forallt>tQ. (2.139) 

Moreover, suppose that one of the following properties holds: 
(iv) 

c(T, s) := sup j II Trito + $)x || ; sup|M(r)| <s,$e [0, T], xq e C°{[-r, 0]; !H"), 

^ f>0 

\\xo\\r <s,toe [0, T], {d,u) e a\ < +00, 

(v) there exist functions a e Kca, M G K'^ and a constant R >0 such that 
a(fi(t)\x(0)\) < P\it, x) + R for all (t, x)em+ x C°([-r, 0]; Sft"). 

Then for all (to, xq, d, u) e di+ x C^([-r, 0]; M") x A, the solution x(t) o/(1.10) 
with initial condition Tr(tQ)x — xq corresponding to input (d, m) e A exists for all 
t >tQ and satisfies (2.139). 

Proof We distinguish the following cases: 

(a) Property (iv) holds. 

The proof will be made by contradiction. Suppose on the contrary that there exist 
(to, XQ, d, u) e i)J+ X C'^([-r, 0]; J){") x A and fi > to such that the solution x(t) 
of (1.10) with initial condition Tr(to)x = xq corresponding to input (d, u) e A sat- 
isfies 

Pi(ti, Tr{ti)x) > P2(tiJo,xo,d,u) 
(1.9) and property (iv) implies that, for all Xq e C°([-r,0]; i)i") with Uxo-iollc < 1^ 

/ J^ 

\\T,(ti)x-TAti)xl<J-^\\xo-xo\\rexp{K-^L(ti,cKti-to)) (2.140) 
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where x(t) denotes the solution of (1.10) with initial condition T',.(fo)x = xq cor- 
responding to input (d,u) e A, and c — 2c(ti, \\xo\\,- + 1 + sup, <,.<, |M(r)|) + 

suPfo<T<f, \uiT:)\- 

Let e := Piitu Tr(ti)x) - fi2(ti,to,xo, u) > 0. Using property (iv), (2.140), the 
fact that CH[-r,0]; S)i") is dense in C°([-r,0]; D^"), and the continuity of the 
mappings x ^ Pi (ti , x) and x -^ Piih ,to,x, d, u), we conclude that there exists 
xo e CHl-r, 0]; Sit") such that 

Ik0--«0llr < 1; \P2itl,tQ,XQ,d,u) - P2(tl,t0,X0,d,u)\ < - 
\Pl{tl,Tr(h)x)-Pi{n,Tr(h)x)\<^ 

where x(t) denotes the solution of (1.10) with initial condition T,.(to)x — xq corre- 
sponding to input {d,u) e A. Combining property (iii) for x(t) with the above in- 
equalities and the definition of e, we obtain Pi {ti , Tr (ti )x) > Pi (ti , Ty (?i )x), a con- 
tradiction. 

(b) Property (v) holds. 

It suffices to show that property (iv) holds. Since there exist functions a e Koo, 
fx e K+, and a constant R >0 such that a(/i(f)|x(0)|) < Pi(t,x) + R for all 
(t,x) e 9{+ X €"([— r, 0]; 9i"), it follows that from property (iii) that for every 
(to, xo, d, u) e m+ X C' ([-r, 0]; 9t") x A, the solution x(t) of (1.10) with initial 
condition Tr{to)x — xo corresponding to input (d, u) e A satisfies 

a(/i(f)|x(r)|) < R + P2(t,to,xo,d,u) for all r > to 

Moreover, making use of property (ii) and the above inequality, we obtain that for 
every {to,xo,d,u) e S1t+ x C\[-r,0]; m") x A, the solution x(r) of (1.10) with 
initial condition Trito)x — xo corresponding to input {d, u) e A satisfies, for all 
t>to, 

\\Tr(t)x\\<\\xo\\r + l + ^—a~UR + M(t,\\xo\\r+ &up\uir)\)) (2.141) 

' M(0 ^ ^ lQ<T<t >> 

Notice that in order to obtain inequality (2.141), we have also used the causality 
argument that the solution x(t) of (1.10) with initial condition Ty(to)x — xq cor- 
responding to input {d, m) e A depends only on the values of the input u on the 
interval \to, t\. 

We claim that estimate (2.141) holds for all {to,xo,d,u) e di+ x C°([-r, 0]; 
Df ) X A. Notice that this claim implies directly that property (iv) holds with 

c(T,s):^s+l-\ a~^(R+ max M(r,x)) 

mino<r<27" A''(''') ^ 0<jr<2i,Q<T<27" / 

The proof of the claim will be made by contradiction. Suppose on the contrary 
that there exists (to, xq, d, u) e !M+ x C°([-r, 0]; iM") x A and fi > to such that the 
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solution x{t) of (1.10) with initial condition T,-{tQ)x — xq corresponding to input 
{d, u) e A satisfies, for all t > to, 

\\Tr(ti)x\\>\\xo\\r + l + ^—a~^(R + M(ti,\\xo\\r+ sup |M(r)|)) (2.142) 
m(?i) ^ ^ to<T<t, '// 

Let B :— sup, <^<. ||T',-(r)x|| < +oo. Using (1.9) and (2.141), it follows that 
(2.140) holds for all 



and 



xo e C^ {[-r, 0]; di") with ||xo - io||, < 1 
a-^(R + M(t,s)) 



c — B + \\xo\\r +2 + max 



flit) 



■,0<s < \\xo\\ 



+ sup |M(r)|, ro <?<?!> + sup |M(r)| 
ro<T</i J to<T<ti 

where x{t) denotes the solution of (1.10) with initial condition Tr(to)x — xq corre- 
sponding to input {d,u) e A. Let 

e:= ||7;(fi)x|L- llxoll,-- 1 --a~^(R + M(ti,\\xo\\r + sup |M(r)|))>0 

Using (2.140), (2.141), the denseness of C\[-r,0]; 9i") in C°i[-r,0]; M"), and 
the continuity of the mapping 

X ^ g{x) := \\x\\r + I -\ -—a~UR + M(ti,\\x\\r+ sup |M(r)|)) 

fJ-iti) V V ro<T<ti '' 

we conclude that there exists xq e CH[— r, 0]; i)i") such that 

fjco-.Jol^ < 1 |g(j^o)-g(-«o)| < 2 lll^'-(^i)-^IL-~ ll^'-^^i^-^ILI - 2 

where x(t) denotes the solution of (1.10) with initial condition Tr{tQ)x — xq corre- 
sponding to input (d, u) e A. Combining (2.141) for x{t) with the above inequali- 
ties and the definition of e, we obtain ||7'^(fi)x||r > ||r,.(fi)x 11^, a contradiction. The 
proof is complete. D 

Finally, we show how we can overcome the fact that it may not be required that 
the Lyapunov functional bounds a certain function of the norm of the output. The 
following definition introduces an important relation between output mappings. The 
equivalence relation defined next will be used extensively in the following sections 
of the present work. 

Definition 2.5 Suppose that there exists a continuous mapping h : [— r, +oo) x 
9t" -^ iW with h(t, 0) = for all t > -r and functions ai, 02 e Koo such that 
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fli(|/z(?,x(0))|) < \\H(t,x)\\y < a2(sup0g[_,_o] |/i(r + 0,x(e))\) for all (t,x) e 
9J+ X C'^([-r, 0]; S1{"). Then we say that H : 9J+ x C°([-r, 0]; di") ^ y is equiv- 
alent to the finite-dimensional mapping h . 

For example, the identity output mapping H{t,x) — x e C''([— r, 0]; SR") is 
equivalent to finite-dimensional mapping h{t, x) = x e di". 

We are now in a position to state the main Lyapunov sufficient condition for 
RGAOS. 

Theorem 2.5 Consider system (1.10) under Hypotheses (Sl-4) and suppose that 
system (1.10) is RFC. Moreover, suppose that there exist functions a\,a2 e A'oo, 
y6, y e A""*" with Jq Y(t)dt — +oo, tp e S, a positive definite locally Lipschitz 
function p : St"*" -^ ;)i"'", and a mapping V : Di"*" x C^([—r, 0]; Ot") -^ Dt"*", which is 
almost Lipschitz on bounded sets, such that 

ai{\\Hit,x)\\y)<V(t,x)<a2{p{t)Mr) 

W(t,x) e di+ X C°([-r,0]; di") (2.143) 

V°{t,x; f{t,x,0,d)) < -y(t)p{V(t,x)) + Y(t)(p( / Y(s)ds 

for all (t, X, d) e m+ X C°{[-r, 0]; !){") x D (2.144) 

Then system (1.10) is RGAOS. Furthermore, 

(i) if H : SW"*" x C ([— r, Q];di") —^ y is equivalent to the finite-dimensional con- 
tinuous mapping h : [— r, +oo) x S)t" — >• ilf, then inequality (2.143) can be re- 
placed by the following inequality: 

ay{\h{t,x{Q))\) < V(t,x)<a2{Pit)\\x\\r) V(f,x) e m+ x C°([-r,0]; Di") 

(2.145) 
(ii) (/ there exist functions a G A'oo, fi E. K'^, and a constant R > such that 
fl(/x(0|x(0)|) < V(t,x) + Rfor all (t,x) e !W+ x C°([-r, 0]; !){"), then the 
requirement that (1.10) is RFC is not needed. 

Finally, if(p{t) = 0, y(t) = 1, and P(t) = 1, then system (1.10) is URGAOS. In 
this case, if H : Dt"*" x C ([— r, 0]; di") — >• y is equivalent to the time-periodic finite- 
dimensional continuous mapping h : [— r, +oo) x !1{" — >• 9t^, then inequality (2.143) 
can be replaced by inequality (2.145). 

Proof Cfl.je7:(1.10)isRFC. 

Consider a solution x{t) of (1.10) under Hypotheses (Sl-4) corresponding to ar- 
bitrary d e Md and m = with initial condition Tr{tQ)x — x^e C^{[—r, 0]; DJ"). By 
Lemma 2.17, for every T e (to, +oo), the mapping [to, T]3 t —>■ V(t, Tr(t)x) is ab- 
solutely continuous. It follows from (2. 144) and Lemma 2. 16 that jiiV{t, Tr(t)x)) < 
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—y{t)piyit, Tr{t)x)) + y(t)(p(fQ y{s)ds) a.e. on [to, +00). The previous differ- 
ential inequality, in conjunction with the comparison Lemma 2.15, shows that there 
exist a e KL and a constant M > such that 



V{t,Tr(t)x) <a(v{tQ,XQ) + M, y(s)ds] for all f > fo (2. 



146) 



It follows from Lemma 2.18 that the solution x(t) of (LIO) under Hypotheses 
(Sl-4) corresponding to arbitrary d e Md and m = with arbitrary initial condition 
Tr{tQ)x = xo e C°([-r, 0]; i)J") satisfies (2.146) for all t > Iq. Next, we distinguish 
the following cases: 

1. If (2.143) holds, then the Robust Output Attractivity Property (Property P3 of 
Definition 2.2) is a direct consequence of (2. 143) and the fact that /g °° K (0 dt — 
+00. It follows from Lemma 2.1 that system (1.10) is RGAOS. 

2. If (2.145) holds, then (2.146) implies the following estimate: 

\h{t,x{t))\<a~[^{a{a2{fi{tQ)\\xQ\\r) + M,i y(i)fifs|| forallf>ro. 

Since h : [-r, +00) x di" ^ ?RP is continuous with h(t, 0) = for all t > -r, it 
follows from Lemma 2.3 with a{r, s) :— max{\h{t — r, x)| : t e [0, t], \x\ < s] that 
there exist functions ^ e Koo and 8 e K~^ such that 

\hit-r,x)\ <^{8(t)\x\) forall(f,x)e9i+ x 9{" 

Combining the two previous inequalities yields 

sup \h{t + 6,x(t + e))\ 
0el-r,O] 

< max{a;"'(CT(a2(</)(fo)lkoll/-) + M, O)), ^{(p(tQ)\\xo\\,-)} for all t e [to, to + r] 

sup \h{t + 6,x(t + e))\ 

<a'[Uaia2{fi(to)\\xo\\r) + M, y(s)ds]] for all f > ro + r 

where 4>{t) := /S(f) + maxo<r<r+/- S(r). The above estimates, in conjunction with 
the facts that ff^°° y(t) dt = +00 and // : S1{+ x C°([-r, 0]; di") ^ y is equivalent 
to the finite-dimensional mapping h (Definition 2.5), show that the Robust Output 
Attractivity Property (Property P3 of Definition 2.2) holds. Hence, system (1.10) is 
nonuniformly RGAOS. 

Case 2: There exist functions a e Koo, /J. & K~^, and a constant R >0 such that 
a{fi{t)\x{0)\)<V(t,x) + R forall(f,x)e9t+ xC*'([-r,0];9r) (2.147) 
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Consider a solution of (1.10) under Hypotheses (Sl-4) corresponding to arbi- 
trary d e Md and m = with initial condition Tr(to)x — xq e C^([-r,0]; M"). 
By Lemma 2.17, for every T e (to, fmax), the mapping [to, T] 9 f — >• V{t, Tr(t)x) 
is absolutely continuous. It follows from (2.144) and Lemma 2.16 that for 
every T e (fo, Wx), it holds that ^(V(t,Tr(t)x)) < -y{t)p(V(t,Tr(t)x)) + 
yit)(p(fQ y{s)ds) a.e. on [to, T]. The previous differential inequality, in conjunc- 
tion with the comparison Lemma 2.15, shows that there exist a e KL and a constant 
M > such that (2.146) holds for all t e [to, T]. 

Combining (2.143), (2.146), and (2.147), we obtain 

\x(t)\<——a-^((r(a2{^ito)\\xo\\r) + M, Y(s)dsj + R] for allt e[to,T] 

(2.148) 
Estimate (2.148) shows that ?tnax = +oo, and consequently estimates (2.146) 
and (2.148) hold for all t > to. 

It follows from Lemma 2.18 that the solution x(t) of (1.10) under Hypotheses 
(Sl-4) corresponding to arbitrary d e Md and m = with arbitrary initial condition 
T,.{to)x = xo e C°([-r, 0]; S)i") satisfies (2.146) and (2.148) for all t > to- There- 
fore, system (1.10) is RFC, and the Robust Output Attractivity Property (Property 
P3 of Definition 2.2) is a direct consequence of (2.146) and (2.143) (or (2.145)), as 
in the previous case. 

Finally, notice that if q){t) = 0, y(0 = 1, then Lemma 2.13 shows that there 
exists a e KL such that 

V{t,Trit)x)<a{V(to,xo),t-to) for all f > fo (2.149) 

instead of (2.146). Utilizing (2.143) with P{t) = 1 and (2.149), we obtain (2.11). 
Therefore system (1.10) is URGAOS. If (2.145) holds, then (2.149) implies the 
following estimate: 

|/z(r,x(f))| < a^^ [cj [a2{Pito)\\xo\\r) , t -to)) for all f > ?o 

Since h : [—r, -|-oo) x Dt" ^- Of is continuous and time-periodic (say, with period 
r > 0) with h(t, 0) = for all t > —r, it follows from Lemma 2.4 (applied to the 
continuous function a{s) := max{\h(t — r,x)\ : t e[0, T], \x\ < s}) that there exists 
a function i; e K^o such that 

\hit-r,x)\ <^{\x\) for all (f , x) e 9i+ x Di" 

Combining the previous two inequalities, we obtain 

sup \h{t + e,x(t + 9))\ <max{^{\\xo\\r),a'[^{a{a2{\\xo\\r),0))} 

ee[-r.O] 

for all t e [to, to + r] 

sup \h{t + e,x(t + e))\ <aj"'(CT(a2(||xo||,),f-fo)) 

8e[-r,Q] 

for all f > fo + '" 
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The above estimates, in conjunction with the fact H : M"*" x C^{[—r, 0]; Df ) — >• y 
is equivalent to the finite-dimensional mapping h (Definition 2.5), show that Prop- 
erties PI, P2, and P3 of Definition 2.3 hold. Hence, system (1.10) is URGAOS. The 
proof is complete. D 



2.7 Examples of the Method of Lyapunov Functionals 

In this section we present some examples of the use of Lyapunov functionals for 
the proof of RGAOS. In all cases we will show RGAOS without assuming any 
knowledge of the transition map; this is the advantage of the method of Lyapunov 
functionals. 

Example 2.7.1 Consider the system 

hit) = -2gi{t)xi(t) + diit)g2(t)xf{t) - g3{t)xl(t) + d2(t)b(t)\x2{t - r(t))\'' 

X2(t) = c(t)X2it) 

(2.150) 
Y(t)^xi(t)em 

x(t)^ {xi(t),x2it))' em^ d^idi, d2)eD:^[-l,l] x [-1,1] 



where gi e K+, g2 : di+ -^ !){, g3 : di+ -^ di+, b:di+ ^ m, and c : di -^ di are 

1 

2 



continuous functions, and p > i is a constant. We consider system (2.150) under 



the following hypotheses: 

(Al) There exist a continuous function g e K'^ with f^ °° g(s)ds — +oo and a 
constant M > such that Mg(t) < gi(t) for all t > 0. Moreover, gjit) < 
4gi(t)gi(t)foTal\t>0. 

(A2) The function r : di'^ — >• 9{ is continuously differentiable, nonnegative, and 
bounded from above by a constant r > 0. 

(A3) There exist constants K,m > such that, for all f > 0, 

\b(t)\^ { /"-^W \ / rt \ 

expl 2p / c{s)ds ] < K[\ — r{t))e\m —mt — I g{s)ds]. 

8i(t) \ Jo J V ^0 / 

(2.151) 

For example. Hypotheses (AI-3) are satisfied for p = 2, T(t) :=2+j sin(0, c(t) = 
1, b(t) = 1, gi(t) = exp(6/), giit) = exp(r), g^it) = I, with git) = I, M := I, 
A" := 2, m := I. We next show that system (2.150) under Hypotheses (Al-3) is 
nonuniformly in time RGAOS. We consider the functional 

V(t,x):= -x^(0) + exp(-p~^mt- / [p'^ g(s) + 2c(s))ds\xj(0) 
+ ^exp(-mt- f {gis) + 2pc(s))dsj\x2(.0)\^'' 
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K { f 

+ — expl— mr— / g(s)ds 

xj exp(-ms-2pj c{$)dA\x2(s)f'' ds (2.152) 



Since p > j, it follows that the functional defined by (2.152) is almost Lipschitz on 
bounded sets. Moreover, inequalities (2.143) hold with H{t, x) = Jri(O) ey :— di, 
ai(s) := 2~^s^, 02(5) := s^ + 2~^K{m~^ + r exp(mr))s^P , and yS(r) := 1 + 
maxo<5<,exp(-^^ - jj^ f^ gis)ds)max-r(^)<s<oexp(- f^'^' ciw)dw). Fur- 
thermore, we obtain, for all (f , x, d) e i)i+ x C°([-r, 0]; DJ^) x D, 

V''{t,x;-2gi(t)xm + dig2(t)xjm-g3(t)x'i(0) + d2Ht)\x2i-r(t))\'', 

c(t)X2(0)) 

<-2gi(Ox2(0) + |g2(0||^i(0)|'-g3(0^?(0)+|^(0|ki(0)||x2(-r(f))|" 
-p-^{m + g(t))exp(-p-^mt- / (p'^ g(s) + 2c(s)) dsjxj(0) 

- f {g(s) + 2pc(s))ds\\x2(0)\ 

f gis)ds) f 

Jo / J-z( 

f 

Jo 

K / f' ft-r(r) \ 
(1 - f(0)expl -m(f-T(f)) - / g{s)ds-2p c(s)ds\ 

X \x2{-r(t))f 

Hypothesis (Al) implies that -gi (f)x^ + |g2('^)l ki P - g3(t)x^ < for all (t, xi) e 
m+ X m. Using the inequality |fe(0||xi(0)||x2(-T(0)|'' < 2-^gi(t)x^{0) + 
j^\x2(-r it))\'^P in conjunction with (2.151), we obtain: 

V\t,x;-2gdt)xi(0) + dig2it)x^y(0)-g3it)xl(0)+d2b(t)\x2{-r{t))\'', 

c(t)X2(0)) 

1 



K I I- , \| |2n 

■git)—exp[-mt ' '"^"' ' -^"'•^^^w. ii„.mM 

K 

■g(f)— exp -mt 

^ \ .10 / J-T{t) 

X expl —mi' — 2/7 / c(§) (if ) 1x2(5)1 '^ ds 



<-:^gi{t)x'l{G) 



p ^g{t)txpi-p ^mt-i {p ^g{s) + 2c(s))dsjxl{0) 
J {g(s) + 2pc(s))ds\\x2(0)\ 



j(f) exp( — mr ' ^"'-^ I ^"-^-^^ -v^ 1 l--''n\l P 



104 2 Internal Stability: Notions and Characterizations 

-gCOyexpf-mr- / g(s)ds 



f 

Jo 

/expj —ms — 2p I c(^)d^ )|-^2(*)| '' ds 
-T(t) \ Jo J 



< 



for all (t, X, d) e 9t+ x C°([-r, 0]; Dt^) x D. 

Since Mg(t) < giit) for all t >Q, the above inequality, in conjunction with def- 
inition (2.152), gives, for all (t, x, d) e 91+ x C^{[-r, 0]; Slt^) x D, 

:(r)x2(0)) 
-mm[M,p-\\]g{t)V{t,x) 

Consequently, inequality (2.144) holds with 

p(s):—s (p(t) = and y(t) ■.— min{M, p~^ ,l]g(t) 

If system (2. 150) were RFC, we would have showed all hypotheses of Theorem 2.5. 
However, since the inequality a(ti(t)\x(0)\) < V(t,x) + R holds for all {t,x) e 
d\+ X C^{[-r, 0]; df) with R := 0, a(s) := s^ and 

M(f):=(min(2-';expf--f- f (^-^(s) + 2c(i)) J^ jj j 

the requirement that system (2. 150) were RFC is not needed. Thus we can conclude 
that system (2.152) is RGAOS. 

Moreover, if, in addition to Hypotheses (Al-3), the following hypothesis holds 
as well: 

(A4) There exist constants F, A > such that g(t) > F and 

ct+w 



m 

— t . 

2/7 2/7 



— / g(s) ds + min / c{s) ds > —A for all f > 

■P Jo -T(t)<w<OJo 



then we can conclude that system (2.150) is URGAOS. Notice that if (A4) 
holds, inequalities (2.143) and (2.144) hold with pis) := min{M, p~\ l}F.j, 
H(t, x) = xi(0) ey-.^ di, ai is) := I'h'^, a2(s) := exp(2A)i2 + 2-i^(m-' 4 
r exp(mr)) e.x^(2pA)s^P , (p(t) = 0, yit) = 1, and /S(f) = 1. Consequently, all 
hypotheses of Theorem 2.5 hold (without the requirement that system (2.150) 
is RFC). 

Theorems 2.4 and 2.5 can be used for the proof of RFC (simply consider the 
system with zero output map H{t, x) = 0). The following example illustrates this 
point. 
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Example 2. 7.2 Consider the following system described by ODEs: 

X = c\it, d)x + C2(f, d)x^ + C3(f, d)x^ 
xedi,t>0,deD (2.153) 

where D C Sit"' is a compact set, c,(-) e C''(S){"'" x D), i — 1, 2, 3, are continuous 
mappings for which there exists a function 4> e K~^ such that 

2(Pit)c3(t,d)<-\c2it,d)\ for all (t,d)em+ X D (2.154) 

We next prove that this system is RFC. Consider the Lyapunov function candidate 

(2.155) 



W(t,x) -.— expl — I I 1 + 2max|ci(T,(i)| +(7l)(r)max|c2(r,cf)| li^T ||x| 
\ Jq y deD^ ' rfeZ)' '/ J 



Clearly, we have, for all (t,x,d) e f)}"*" x S){ x D, 

dW dW , , ,, 

(t, x) H (f , jc)(ci (f , (i)x + C2(t, d)x + C3(f , d)x ) 

dt dx 

— -(1 + 2max|ci(f,(i)| + (h(t)ma.x\c2{t,d)\)wit,x) 

+ (2ci(f , d)x^ + 2c2(t, d)x^ + 2c3(f , d)x^) 

X expl — / ( 1 + 2max|ci(r, (i)| +(/>(T)max|c2(T,(i)| ) lit I (2.156) 
V Jo ^ ^ei* '^e-o' 7 / 

It follows from inequality (2.154), in conjunction with the Young inequality 

2c2(f, d)x^ < (p{t)\c2{t, d)\x'^ + ^^^TTy^x'*, that the following inequality holds: 

dW dW , o ,, 

(t,x)-\ (t,x)[ci{t,d)x + C2it,d)x'^ + C},it,d)x^) < -W(t,x) 

dt dx 

forall(f,x,^)eS1{+ xdix D 
The reader should notice that all hypotheses of Theorem 2.4 hold with 
H(t,x) = Q a(s) — a2(s) :— s^ 

u(f):=exp( — / 1 1 + 2max |ci(r, (i)| +(/>(T)max |c2(r, (i)| jiii 
V 2 Jo V deD ' ' deD ' V 

P(t)^y{t)=l p{s):^s (pit) = and R:^0 

Thus system (2.153) with zero output map is URGAOS. Particularly, this implies 
that system (2.153) is RFC. 

Example 2.7.3 Consider system (1.7) which arises in the study of the chemostat 
model (1.4) of Example 1.2.1 in Chap. 1. Here we assume that Sin{t) = s^ (i.e.. 
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U2(t) = from (1.6)), D(t) = D* (i.e., ui{t) = from (1.6)), b^O (i.e., R := 1), 
and K(s) = K (i.e., p(x2) = 1). Therefore the transformed chemostat model (1.7) 
takes the simple form 

ii = D*g(x2) 

i2 = £)*exp(-X2)[M(l-exp(xi)) - Mg(x2)exp(xi) + 1 - exp(x2)] 

x^ixi,x2)em^ (2.157) 

Moreover, we will assume that the specific growth rate fj.{s) of the microbial species 
is a nondecreasing, locally Lipschitz, bounded function /x : [0, +oo) -^ [0, +oo) 
with ii{0) — 0, ii{s) / D* for all s / s*, and /x(5) > for all .y > 0. Notice that 
the previous requirements are automatically satisfied if /x : [0, +oo) -^ [0, +oo) 
is strictly increasing, but here we will avoid to make such an assumption. Con- 
sequently, the function g : di —>■ (—1, -|-cxd) is a nondecreasing, locally Lipschitz, 
bounded function with g{0) — 0, limt2^-oo g(jf2) — —1, and g(x2) ^ for all 

X2/0. 

We will show that system (2.157) is URGAS (although in this case the adjective 
"robust" does not apply since no disturbances appear in model (2. 157)). To this end, 
we will use the Lyapunov function 

y(x) = exp(xi)-xi - 1 + B(x2)+ e(l-exp(x2) + M-Mexp(xi))^ (2.158) 

where B(x) := M"' f^ ^g^ exp(u;) dvu ^ j^^ //^''P^"^' i^^ ds, and g > 

is a constant. We first notice that the function V : Di^ -^ [0, +00) is a continu- 
ously differentiable function with V{Q) — and V'(x) > for all x ^ 0. For ev- 
ery a > 0, the set {x e Dft^ : Vix) < a] is compact. Indeed, this follows from the 
equalities limt|^±cxD(exp(xi) — xi — 1) = +00 and limj^j^ioo B(x2) — +00. No- 
tice that for all X2 > 0, it holds that B(x2) > xr?* K''''Pfa> /^(f)-^* ^^, where 

IVIS •J S Mmax 

/Xniax — sup^^g/x(i), which shows that limjc^^+oo B(x2) — +00. The equality 
lim^^^-oo B{x2) — +00 follows from the fact that the function /x : [0, +00) —>■ 
[0, +00) is locally Lipschitz and thus there exist p, L > with ii(s) < Ls for all 
< 5 < p. Consequently, for all X2 < ln(4), we obtain the following inequalities 
which show that limjr,^_oo B(x2) — +00: 



B(X2)= / '-—ds> / ^--^ds 

Ms* J.5*exp(jc,) f^is) Ms* Js*exp(x,) 



fiis) 

P(JC2) /^(■^) ~ Ms* Js*sxp(x2) fJ-is) 

ds 



D* j-P ds p D* j-P 

- Ms* i,*exp(«) M(5) Ms* - Ms*L ],*, 
D*{\n(p)-\n(s*)-X2) p 



s*exp(x2) f^y^) ^■^ ^"^^ ^ Js* exp(x2) ^ Ms* 



Ms*L Ms* 

The following proposition helps us at this point. 
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Proposition 2.2 Let V : SH" -^ [0, +oo) be a continuous function with V{Q) — 
and V{x) > for all x ^ 0. Moreover, assume that for every a > 0, the set 
{x e Dt" : V(x) < a} is compact. Then there exist functions ai, fl2 C ^oo such that 
fll(kl) < y{x) < a2(\x\) for all x e di" . Furthermore, if P : W -^ [0, +oo) is a 
continuous function with f (0) = and P(x) > for all x ^0, then there exists a 
locally Lipschitz positive definite function p : St"*" —^ Ot"*" such that p{V(x)) < P{x) 
for all X em". 

Proof of Proposition 2.2 The function a{s) :— max{y(x) : x e J){", |x| < i} is a 
nondecreasing (and tiius locally bounded) function with lim5^o+ '^'(j) = fl(0) = 0. 
Therefore, Lemma 2.4 implies the existence of aj e K^^ such that a(s) < a2{s) for 
all .J > and consequently, V(x) < a2(\x\) for all x € 9t^. On the other hand, since 
for every a > 0, the set {x e Dt^ : V(x) < a] is compact, it follows that the func- 
tion /J(i') :— min{y(x) : x edi", \x\ > i'} is a well-defined, nondecreasing function 
with lim5^_|_oc P(s) — +00, P{Q) — and P(s) > for all i' > 0. The reader should 
verify all previous statements (which require knowledge of real analysis!). The func- 
tion ai(s) :— -^ Jq Piw) dw — j^ f^ Piks) dX defined for 5 > is a Koo function 
which satisfies all requirements. 

Finally, consider p(s) :— min{P(x) : x e di" , 1 < V(x) < s] for all i' > 1 and 
p(s) :— min{P(x) : x e di" , s < V(x) < 1} for all < 5 < 1, which is positive defi- 
nite, nondecreasing on [0, 1] and nonincreasing on [1, +oo). Define the constant 



a :=min 



p(w)dw, I p{w)dw 



- / p(w)dw, / 



and the function 



2fl L p(w)dw 

p(s):^ ■'y forO<s<l 

■^ + 1 J„ p(w)dw 

and 

f'^ p(w)dw 

p{s):—a-^ for5>l 

/j p{w)dw 

The function p : ?R'^ —^ !){"'" is continuous, positive definite, and satisfies p(s) < p{s) 
for all 5 > . By virtue of Remark 2 .4, the function p{s) :=inf{yO(3') + |3/ — .?!; y >0} 
satisfies all requirements. D 

Therefore, by Proposition 2.2 it follows that there exist ai,a2 € ^oo such that 
(2.129) holds with yS(f)= 1 and //(f,x, 0) := x. 
It is a matter of easy manipulation to show that 



yO(x; fix)) = -P(x) 
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where 

P{x) := M- \ ^^-^f D*[Mg(x2) + expfe) - l] 

+ 2D*2(1 - exp(x2) + M - Mexp(xi))^, 
/(x) := D*[g(x2),exp(-X2)(M(1 -exp(xi)) - Mg(x2)exp(xi) + 1 -exp(x2))]' 

Notice that P : y\^ -^ [0, +oo) is a continuous function with P(0) = and P(x) > 
for all X / 0. It follows from Proposition 2.2 that (2.130) holds with (pit) = 0, 
y{t) = 1, and appropriate locally Lipschitz positive definite function p : Di"*" — >• Dt"*". 
The proof that system (2. 157) is URGAS is finished with the help of Theorem 2.4. 
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In this section, the method of Lyapunov functionals is developed for discrete-time 
systems of the form (1.110) under Hypotheses (Ll-3). Particularly, we have the 
following technical result. 

Proposition 2.3 Consider system (1.110) under Hypotheses (Ll-3). Suppose that 
there exist functions V : it x X —^ Di"*", fli,fl2 C ^oo, ^3 G C (Dt"*"; Dt"*") being 
positive definite with a-i(s) < s for all s > 0, P E: K^ , and g : tt — >• St"*" with 
lim;^_l_oo ^(■'^i) — such that, for all (i, x, d) e Z"*" x X x D, 

ai(||H(r,-,x,0)||y)<y(r,,x)<a2(;6(r,)||x||;^) (2.159) 

y(r,+i,/(r,-,rf,x,0)) < V(ri,x)-a3{V(ri,x)) + q(ri) (2.160) 

Then system (1.110) is RGAOS if one of the following holds: 

(i) fl3 e K, or 
(ii) TaLq^M <+oo. 
Moreover, if in addition, q = and P(t) = 1, then system (1.1 10) is URGAOS. 

For the proof of Proposition 2.3, we need the following technical result. 

Lemma 2.19 Let a e K with a{s) < s for all s >0, M e (0, j lim.s^+oo a(s)), and 
consider a sequence {V,- e ft"*"}^ which satisfies the following inequality: 

Vi+i<Vi-a{Vi) + M for all i > ko e Z+ (2.161) 

Then the following inequalities hold: 

Vi < Vko + a~\M) + M for all i > ko e Z+ (2.162) 

Vi < a-\2M) + M for all i>ko+— (2.163) 
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Proof of Lemma 2.19 We first prove (2.162) by induction. Notice that (2.162) holds 
for / — ko. Suppose that (2.162) holds for some / e Z"*" with / > ^o- Consider the 
cases: 

• if a(V,) > M, then (2.161) implies V,+i < V,, and consequently (2.162) holds for 
i + l, 

• if a(V,) < M or equivalently if V,- < a~^{M), then (2.161) implies V,+i < V, + 
M < fl~' (M) + M, and consequently (2.162) holds for / + 1. 

Next, we prove the following claim: if (2.163) holds for some i — k e Z"*" with 
k > ko, then (2.163) holds for all / > k. Consider the cases: 

• if fl(V,) > M, then (2.161) implies V/_|_i < V,, and consequently (2.163) holds for 

i + l, 

• if a(V,) < M or equivalently if V, < a~^{M), then (2.161) implies V,+i < V, + 
M < a~^(M) + M < a~^(2M) + M, and consequently (2.163) holds for / + 1. 

The proof of inequality (2.163) is made by contradiction. Suppose that there ex- 
ists A: e Z+ with k>kQ+-^ such that Vk>a~'^(2M) + M.'Qy virtue of the previ- 
ous claim, this implies that V, > a~^(2M) + M for all i — ko, . . . ,k. Consequently, 
we have — a(V,) + M < —M for all i — ko, . . . ,k. Thus, we obtain from (2. 161): 

Vi+i<Vi-M foTal\i^ko,...,k (2.164) 

Clearly, (2.164) implies that Vjt < Vjto ~ M(k — ko), and this estimate along with 
k > ko + -jf gives Vjt < 0. Clearly, this implication is in contradiction with the 
assumption V^ > a~' (2M) + M > 0. The proof is complete. D 

We are now in a position to provide the proof of Proposition 2.3. 

Proof of Proposition 2.3 Notice that Lemma 1 .3 implies that system (1 . 1 10) is RFC. 
Thus, by virtue of Lemma 2.1, it suffices to show the Robust Output Attractivity 
Property (property P3 of Definition 2.2). Let e >Q, R,T >Q arbitrary and consider 
the solution x{t) of (1.110) with initial condition x{to) — xo with \xo\ < R, to & 
[0, T] corresponding to d eMo and m = e My. Let J{T) e Z+ with q„(T) := 

t:j(T)- 

We distinguish the following cases: 

Case of (i): Let M = M(e) e (0, jlim^^ +0003(5)) with a^'(2M) -|- M = a^ '(e)- 
There exists N(e) e Z+ such that ^(r,) < M(e) for all / > N{s). Notice that 
(2.160) implies y(r,+i, x(r,+i)) < V(t,-, x(r,)) - 03(^(1,-, x(r,))) + M for all 
(■ > A^(e) with T; >Xs — p„ {to). Lemma 2. 19 and the fact a^' (2M) -|- M = aj"' (e) 

imply that y(r,-,x(T,)) < afi(e) for all i>j + ^^%^ with j = j{e, T) := 
max{Af(e), J(r)}. Moreover, (2.160 implies that V(xj,x{rj)) < y(rj,xo) + 

12k=o ?(^*:)- Using (2.159), in conjunction with previous inequalities, implies 
that 
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V{ri,x{ri))<a-\s) 



for all / > N(s, T, R) := j(s, T) 



M(e) 



with i — j(e,T) :— max{N{E), J(T)}. Therefore, inequality (2.159) gives 
\\H{t,x(t))\\y < £ for all r > to + r(s, T, R) with r(e, T, R) :— r^^^ j. ^j. 

Case of (ii): Define B :— ^/^o ?(^') < +oo. Notice that (2.160) implies 

y (t,+i, x(r;+i)) < y (r/, x(r,)) +q(ri) for all / e Z+ with t; > pjr{to) 

Consequently, we obtain (inductively) y(T;,x(r,)) < V(rs,xo) + B for all / e Z"*" 
with Xj >r,^pj, (to). This implies (using (2.159)) V{ri , x(t,)) < G = G(r, 7?) := 
a2(^maxi=,o,...,y(7')yS(ri.)) + 5+1 for all / e Z+ with r,- > t^ = PnOo)- Also, 
define 

p(i;) :=exp(i) — G) min a3(y) (2.165) 

v<y<G 

which obviously is a strictly increasing, continuous, and positive definite function 
on [0, G]. Clearly, there exists p e K with p(v) — p(v) for all v e [0, G] (e.g., 
piv) -.^ piG) + V - G ioT V > G). Notice that (2.160) and definition (2.165) im- 
plies y(T,+i,x(T,+i)) < y(T/, jc(t,)) — yO(y(r;,x(r;))) + g(T/) for all / e Z+ with 
1^! >: /"jr (fo)- From this point the proof continues with the same procedure as in the 
previous case. 

Case of q = and f}(t) = 1: Notice that (2.160) implies y(r,+i,x(T,+i)) < 
y(r,-, x(r,)) for all ; e Z"*" with r, > p„ito). Consequently, we obtain (inductively) 
y (r,- , X (r,- )) < y (Tj , jto) for all / e Z"*" with r,- > r^ — p„ (to) . The previous inequal- 
ity, in conjunction with (2.159) with P(t) = 1, implies Uniform Robust Lagrange 
and Lyapunov Output Stability. Thus we are left with the proof of the Uniform Ro- 
bust Output Attractivity Property. 

Notice that if V(rk, x(r^)) < aj~ (e) for some k e Z"*" with tk > ts — Pn(to), 
then we get y (t; , x(t,)) < aj~ (e) for all ; > k. 

Let 5(e, R) -.^ {a^iy) : y e [aj"'(e),aj"^(£) +a2(^)]} > 0. We claim that 

Vixi , x(t,)) < a,{E) for all / > .v + 

The proof is made by contradiction. Suppose that there exists k e Z"*" with k > 
s + ffj 1 such that Vk > af (e). By virtue of the previous observation, this implies 

that Vi > flj~ (e) for a\\ i — s, . . . , k. Consequently, we have Vj+i < y — S(e, R) 
for all i — s, . . . ,k. Thus we obtain Vk <Vs — S{s, R)(k — s), and this estimate, in 
conjunction with our assumption k> s + ??: 1 >s+ jrfj^ , gives Vk < 0. Clearly, 

this implication is in contradiction with the assumption Vk > a7 (e). The reader 
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should verify that the inequahty t > to + /"([ w^] + 2) imphes that t > t; with 
i >s + ffj 1 . The proof is complete. D 

Example 2.8.1 Consider the nonlinear finite-dimensional discrete-time time- varying 
system 

xi(f + I) — d(t)xi{t) 

X2(t+l)^2~'d(t)\xiit)\^ 

Y(t)^H{t,x(t)):^X2(t) 

x{t) := (xi(0, X2it)) e !lP, t e Z+, ^(0 e [-2, 2] (2.166) 

with TT — Z"*". Consider the continuous function V{t,x) :— exp(— r)|xi| + \x2\, 
which clearly satisfies the following inequality: 

\Y\^\x2\<V(t,x)<2\x\ forall(f,jc)eZ+ xS1{2 (2.167) 

Moreover, notice that for all (t, x, d) e Z"'" x 9J- x [—2, 2], we obtain 

V{t + l,dxi,2-'d\xi\^) ^ sxp(-t - l)\d\\xi\ + 2-' \d\\xi\^ 



<2e-'exp(-0ki|+2-'+ViP 

2 + e 2e / e\' 

<— exp(-0|x>| + — (^-j 

<XVit,x) + q(t) (2.168) 

where X :— ^ e (0, 1) and q(t) :— ^(5)' with lim,^+oo?(0 = 0. By virtue 
of (2.167) and (2.168), it follows that statement (i) of Proposition 2.3 is satisfied 
with /S(f) = 1, ai(s) :— s, a2(s) :— 2s, and a^is) :— (1 — X)s. We conclude that 
system (2.166) is RGAOS. 

Example 2.8.2 Consider again the cobweb model (1 . 123) with buffer stocks. For the 
case with no government intervention, the corresponding dynamical system (1.123) 
with u{t) = is actually one-dimensional (the state variable X2{t) is constant and 
irrelevant) and is given by the difference equation 

xiit + I) ^ h{xi(t) + Xf,q) - Xf,q (2.169) 

where 

1 if y < ci 

h{y) — l + cir — ry if ci < y < ci + C2 (2.170) 

I -C2r if y > ci + C2 

We consider the following cases: 
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Case 1: If ci + C2 > 1 — C2r and r < 1, then we can show that system (1.123) with 
M(0 = 0isURGAOS. 

Indeed, we can prove this fact by using Proposition 2.3 and by considering the Lya- 
punov function V(xi) :— \xi\. It is a matter of simple but tedious calculations to 
show that the following inequality holds: 

y(/z(xi+Xeq)-Xeq) < y(xi) for all X G *){, Xi / (2.171) 

Define P(xi) := V(xi) — V(h(xi + Xeq) — Xgq). Clearly, inequality (2.171) implies 
that P : i1{ -> [0, +00) is a continuous function with P(0) — and P(x) > for all 
X ^ 0. By Proposition 2.2 there exists a locally Lipschitz positive definite function 
(33 : S)}"*" —^ di~^ such that fl3(V(x)) < P(x) for all x e !){. Consequently, inequali- 
ties (2.159) and (2.160) hold with ai(s) = a2(s) ■.^s,q = 0, and yS(r) = 1. 

Case 2: If ci + C2 < 1 — C2r (or S^ax < "h+d )' '^hen we notice that h(y) >C[+C2 
for all y e di. Thus, for every initial condition xi (0) e di, we obtain 

xi(t)^0 {or P(t)^b-\a-S„,ax)) for all f > 2. (2.172) 

In this case, we can show that system (1.123) with u(t) = is URGAOS, by com- 
bining Lemmas 1.3, 2.1, and 2.2 (notice that system (1.123) is autonomous). In fact, 
in this case the phenomenon of finite-time stability appears as (2.172) shows (i.e., 
the equilibrium point is approached in finite time). 

Thus, in any of the above two cases, system (1.123) with u(t) = is URGAOS. 
The characterization of the set of the parameters for which URGAOS occurs is 
sharp. Indeed, if ci + C2 > 1 — C2r and r > 1 (or ^max > "h+d'^ '^'^'^ '^ — ^)' the dy- 
namics of system (1.123) present the well-known phenomenon of the "hog-cycles" 
or nontrivial period-2 solutions, as described in the economic literature. For the 
mildly nonlinear case (1.123), the "hog-cycles" can be given explicitly: 

• If ci + C2 > 1, a nontrivial period-2 solution is 

Xl,l = 1 -Xeq 

^1,2 = 1 - r(l - Ci) - Xeq < Ci - Xeq. 

• If 1 > ci + C2 and c\ + rc2 > 1, a nontrivial period-2 solution is 

XI, 1 = 1 -Xeq 

■^1,2 — l-rC2- Xeq < Ci - Xeq. 

• If ci + rc2 < 1, a nontrivial period-2 solution is 

XI, 1 = 1 - r(l - Ci) + r^C2 — Xeq > Ci + C2 - Xeq 
XI, 2 = 1 - rC2 - Xeq < Ci + C2 - Xeq. 
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• If r = 1 , there are infinite nontrivial period-2 solutions 

xij e (maxjci; 1 — cj] — ^eq, min{l; C[ + C2} — Xeq) arbitrary 

Xl,2 = 1 + Ci - Xi_i - 2Xeq. 

Thus, we have performed a complete parametric stability analysis for sys- 
tem (1.123). 

As suggested previously, the stability analysis for discrete-time systems is 
strongly related to the discretization approach for Lyapunov stability analysis of 
systems described by ODEs. 

The following result is the main result for the discretization approach for systems 
described by ODEs. 

Proposition 2.4 Consider system (1.3) under Hypotheses (Hl-4) and suppose that 
there exist a function V e C (Di"*" x M"; Di"*") andfunctions ai, aj & K^q, and P, jj. € 
A""*" satisfying (2.129) and the following inequality: 

ai{fM(t)\x\)<V(t,x) forall(t,x)em+ x?li" (2.173) 

Moreover, suppose that there exist a locally bounded function T : (0, +00) -^ 
(0, +00), a positive definite function q e C (DJ"*"; di~^), and a function a e Kqo 
such that for all to > 0, xq G 9{"\{0}, and d G Mo, the solution x(t,to,xo;d) 
of (1.3) with initial condition x{to, to, xo', d) — xq corresponding to d & Md exists 
on [to, to + T(V (to, Xo))] and satisfies the following inequalities: 

V{t,x{t,to,xo;d))<a{V{to,xo)) forallte[to,to + T{V(to,xo))] (2.174) 
min Vit,xit,to,xo;d))<V(to,xo)-q{V{to,xo)) (2.175) 

Then system (1.3) is RGAOS. Moreover, if P{t) = 1, then system (1.3) is URGAOS. 

Proof Let a e KL be the function with the following property. 

(P) If {V/ > 0}~o is a sequence with V,+i < Vi - q{Vi), then Vi < a(Vo, i) for all 
i>0. 

The existence of ct e KL which satisfies property (P) is guaranteed by Lemma 4.3 
in [19]. In order to present a complete proof, we notice that the function a e KL 
can be constructed by following the procedure in the proof of Lemma 2.11 and 
defining v(i) := sup{^ : {Vi}^ e G{Vo), Vo > 0}, where g(s) ^s^ + V^, and 
G(Vo) denotes the set of all sequences { V; > 0}^q with V,+i < V,- - ^(V,) for all 
i > 0. Then we show that v{i) —>■ and the function a e KL can be defined as 
(r{s, i) := g(s)v{i) for all s > 0, i e Z+ and a(0, i) := for all ; e Z+. 
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Define r(0) = 1. Let Iq > 0, xq e !){", and d e Mo arbitrary and define the fol- 
lowing sequences: 



(2.176) 



Xi+\ = x(t; + Si, t/, x,-; d) Ti = r(y(T,-, X,)) 
r,+i = T/ + i/ Vi = y (t/ , x/) / > 

with tq — to, where sj e [0, 1",] satisfies 

V (x (r,- + 5; ,Xi,Xi;d))— min V (x (r,- + .? , t,- , x,- ; cf)) (2. 1 77) 

for the case x, ^ and i', — Ti — \ for the case x, — 0. Notice that by virtue of the 
semigroup property we obtain that x, — x(t; ,to,XQ\d). 

Inequality (2.175) and definitions (2.176), (2.177) imply that 

Vi+i<Vi-q(Vi) (2.178) 

for the case x, ^ 0. For the case x, = 0, by the uniqueness of solution of (1.3) 
we have x,-|_i — 0, and consequently inequality (2.178) holds as well in this case. 
Therefore, property (P) guarantees that 

Vi < cr(Vb, /) for all i > (2.179) 

where a e KL is the function involved in property (P). 

Inequality (2.174), definitions (2.176) and the semigroup property guarantee 
that V(xit, to, xo; d)) — Vix(t, r,, x,; d)) < a(V,) for all t e [ti, t,+i] for the case 
X, ^ 0. By the uniqueness of solution of (1.3), it follows that V(x{t, to, xo; d)) — 
V(x(t, ti, X,-; d)) < a(Vi) for all t e [r,-, ti+i] for the case x,- = as well. Since 
[Vi > 0}^g is nonincreasing (a consequence of (2.178)), we obtain 

V{x{t,to,xo;d))<a{V{tQ,xo)) for all f e [ro, supr,) (2.180) 

Next, we show that 

V{x(t,to,xo;d))<a{V(to,xo)) for all f > (2.181) 

It should be noticed that Robust Forward Completeness, Robust Lyapunov and La- 
grange stability follow directly from inequality (2.181) in conjunction with (2.129) 
and (2.173). Moreover, if P(t) = 1, then Uniform Robust Lyapunov and Uniform 
Lagrange stability follows directly from inequality (2.181). 
For the proof of inequality (2. 1 8 1 ), we distinguish two cases: 

Case 1: supr,- < +oo. 

By virtue of inequality (2.179) we obtain that limV, — and consequently 
\imf^(^f;apzi)- V{x(t,to,xo; d)) — 0. This implies that lim,^(sup^.)- x(f, ro> 
Xo; d) = 0, which implies x(t, to,xo; d) — for all t > supr,. Therefore inequal- 
ity (2.181) is a consequence of (2.180) and the fact that V(x(t, to, xo; d)) — for all 
t > sup r,- . 
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Case 2: sup r,- — +00. 

In this case inequality (2.181) is a direct consequence of inequality (2.180). 

We next show Robust Attractivity. Let e > 0, 5 > 0, /? > 0, (to, xq) e S)i+ x Ot" 
with to e [0, S], \xo\ < R, and d e Mohe arbitrary. By virtue of (2.129), (2.178), 
and the semigroup property it follows that if V, < a~^(ai(s)) for some i > 0, then 
we have \H{t,x(t, to, jcq; d), 0)| < s for all t > ti. Define / :— min{/ > : V,- < 
a-\ai(s))}. Let Ni;(S,R) e Z+ such that (j{a2{Rm£L\o<t<s P(t)), Ns{S, R)) < 
a~'((3i(e)) and notice that inequalities (2.129) and (2.179) imply that J < 
Ns(S,R). 

Next suppose that / > 1. Since V, >a~^(a[(£)) for all /< 7 — 1 (a consequence 
of definition / :— imn{i > : V,- < a~^(a[ (e))}), we get from (2.176) and the facts 
that {Vi > 0}^g is nonincreasing, V{to, xo) < a2(Rinaxo<t<s f^(t)), and that 

r,+i = T/ + Si < Xi + Ti< Xi + fg(S, R) for all /< 7 - 1 

where 

fs(S, R) -.^ suplriV) : a-^ {ai(s)) < V <a-\ai(s)) + a2(R max P(t))] 

Therefore r,-|_i < if^iS, R) for all ( < / — 1, and therefore inequality / < Ne{S, R) 
implies xj < NeiS, R)fs{S, R). It follows that V(x(t, tQ,xo; d)) < a"'(ai(e)) for 
all t>Ns(S,R)f,{S,R). 

The above conclusion holds as well in the case J — 0; namely we have 

V{x(t, to, xo; d)) < fl-'(fli(e)) for all t > N,(S, R)fAS, R) 

Notice that, if ;S(f) = 1, then N^iS, R) e Z+ and 

fAS,R):^suplT(V):a-\ai(s))< V <a-^{ai(s)) + a2(R max P(t)\\ 

are independent of 5 > 0. The proof is complete. D 

Remark 2.7 The reader should notice that the converse of Proposition 2.4 holds 
for the case of Uniform Robust Global Asymptotic Stability (URGAS), i.e., if sys- 
tem (1.3) is URGAS, then for every function V e C°(J){+ x 9J"; 9J+) which satis- 
fies (2.129) for certain ai, 02 e Koc with j6(r) = 1, there exist a function a e Koc 
and a locally bounded function T : (0, +00) —>■ (0, +00) such that for all to > 0, 
Xo e S1t"\{0}, and d e Md, the solution x{t,to,xo;d) of (1.3) with initial con- 
dition x{to,to,xo\d) — xo corresponding to J e Mo exists on [0, Tiy(to,xo))] 
and satisfies inequalities (2.173), (2.174), and (2.175). Notice that (2.173) with 
li{t) = 1 is a direct consequence of (2.129) and the fact that H(t,x,0) :— x for 
all (t, x) e Syt"*" X i)i" . Moreover, since system (1.3) is URGAS, Theorem 2.2 implies 
the existence of a e KL such that for all to > 0, xq e Dt", and d e Mq, the solu- 
tion x{t, to, Xo; d) of (1.3) with initial condition x(to, to, xo; d) — xq corresponding 
to d e Mo satisfies (2.1 1) with H(t, x, 0) :— x. Without loss of generality, we may 
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assume that for each s > 0, the mapping t ^ a(s, t) is strictly decreasing (if not, 
replace a(s, t) by a{s, t) +i'exp(— f)). 

Combining (2.129) and (2.11) with Hit, x, 0) :— x, we obtain 

V{x(t,to,xo\d))<a2{a{a~\V{xo)),t)) for all r > (2.182) 

Let q e (0, 1), and let T{s) > be the unique solution of a2{<y{a~^ (s)T(s))) — 
(1 — q)s for each i > 0. It can be shown that the mapping (0, +cxd) 3 s —>■ T{s) 
is bounded on every compact set S C (0, +oo). Therefore, by virtue of (2.182), we 
conclude that inequalities (2.174) and (2.175) hold with a(s) :— a2(cr(a'[ (s), 0)) 
and q(s) :— qs. 

For the case of nonuniform RGAOS, we can present a result which is useful for 
the solution of important control problems (see Chap. 6). 

Proposition 2.5 Consider system (1.3) under Hypotheses (Hl-4). Suppose that 
there exists a function y e A"*" satisfying 

+ 0O 

^y(2;)<+oo (2.183) 

7=0 

lim K(f) = (2.184) 

It is further assumed that there exist functions a,ai,a2 € K^q, P,ijl & K'^ , p € 
C (Ot"*"; Dt"*") being positive definite such that (2.129) and (2.173) hold and the fol- 
lowing properties are fulfilled for all (fo, XQ,d) € !){"*" x 9t" x Md and j e Z"*" : 

sup V{t,x{t,tQ,xo;d))<a{Vito,xo)) + Yito) (2.185) 

V{2j + 2,xi2j + 2, 2j, xo; d)) < V(2j, xo) - p{V{2j, xo)) + y(2j) (2.186) 

where x(t,to,XQ;d) denotes the unique solution 0/(1.3) with initial condition 
x(tQ) — xq corresponding to d E Md. Then system (1.3) is RGAOS. 

Proof Let (fo, xq, d) e di~^ x di" x Mo, and let j e Z"*" be the smallest integer which 
satisfies fo < 2y . Inequality (2.186) implies that, for any pair of integers / > j. 



V{2i,xi2i,to,xo,d)) < V(2j,x(2y,fo,xo,fif)) + ^K(2yfc) (2.187) 

k=o 

Let M := ES K(2fc) and B := sup,>o K(0- Then, by (2.129), (2.185), and (2.186), 
we get 

V{t,x(t,to,xo,d))<a{a{a2{P(to)\xo\)) + B + M) + B for all r > ro (2.188) 
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Inequality (2.188), in conjunction with (2.129), implies RFC and Robust Lagrange 
Output Stability. Therefore, according to Lemma 2.1, in order to establish RGAOS, 
it suffices to show that system (1.3) satisfies the property of Uniform Output At- 
tractivity on compact sets of initial data. To establish this property, consider ar- 
bitrary constants e > 0, ^ > 0, T > and let (to, xo,d) e Dt+ x !){" x Md with 
fo e [0, T] and |xo| < R. Define K := a{a(a2(Rmax,eio,T] P{t)) + B + M) + B. 
Then by (2. 188) it holds that 

V{t,xit,tQ,XQ,d))<K forall/>fo (2.189) 

Also, define 

p(i):= min p(y) (2.190) 

s<y<K 

which obviously is a nondecreasing and continuous function, and let / > be an 
integer with jpiK) > y(2i) for all integers / > J, whose existence is guaranteed 
from (2.184). Next, consider the sequence 



qi :— inf 



se[0,K]:-p(s)>y(2i)\ fori>J (2.191) 



By virtue of (2.184) and (2.191), q, -^ 0. Consequently, there exists an integer A^ :— 
N{s, K)>J such that 

1 

g,+K(2/)<5(e) and y(2/)<-fli(e) for all ; > A^ (2.192) 

where a^ e Koq is the function involved in (2.129), and 



1 



5(e):=«-M-ai(e)l (2.193) 

Notice next that (2.186) asserts that for all integers / > max(A/^, j), the following 
holds: 

y(2(/ + l),x(2(/ + l),fo,xo;^)) 

< maxj 5(e), V{2i,x(2i, to, xq; d)) p[V[2i,x(2i, to, xo; d))) | (2.194) 

Indeed, in order to establish (2.194), we consider two cases. For the first case, 
assume that Vi2i,xi2i,to,XQ,d)) > qi. Then it follows from (2.190), (2.191), 
and (2.192) that ^p(V (2i, x(2i, to, xq, d))) > yi2i), and this, in conjunction 
with (2.186), implies (2.194). The other case is V{2i,x{2i,to,xo,d)) < qi. Then 
the latter, in conjunction with (2.186) and (2.192), implies again (2.194). 
The following property is a consequence of (2.194): 

V{2i,x{2i,to,xo,d)) <S{e) 

2K 
for all integers / > max(Af, j) H h 1 (2.195) 

p{.S{£)) 
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To show (2.195), suppose on the contrary that there exists integer i > max{N, j) + 
2^ ' 1 with y(2/,x(2(,ro,Jco, c/)) > 5(e). Then, (2.194) would imply 



piSis)) 

V{2k,xi2k,to,XQ,d)) > S(e) 

for all k = max(A^, ;), max(A^, j) + 1, . . . , max(A^, j) + i (2.196) 

By (2.189), (2.190), (2.194), and (2.196) we would have 

V{2(k+r),x{2ik+l),to,xo,d)) < V{2k,x(2k,tQ,XQ,d))- -p{S(s)) 
for all k — max(N, j), max(N, j)+ 1, ..., max(N, j) + / — 1 
and therefore 

V{2k, x(2k, to, xo, d)) < K - [k - max(A?, ;)) -p(5(e)) 

for all k — m2Lx{N, j), max(N, j) + I, ..., max{N, j) + ( — 1 

The previous inequality for k — i gives V(2i, x(2i, to, xo, d)) < S(s), which is a 
contradiction, and this establishes (2.195). 

Finally, by (2.185) and (2.195) we obtain sup^g^/ 2(+2] y(t^(p(t'to,xo;d)) < 
a(Sis)) + y(2i) for all integers i > max(A'^, j) + -Av^^ + 1. This, in conjunction 
with (2.192) and (2.193), gives 

sup y(f, (p(t, to,xo,d)) < a\(s) 

t>2i 

2K 

for all integers / > max(A', /) H h 1 (2.197) 

p{S{s)) 

Using the inequality above and (2.129), we may conclude that the property of Uni- 
form Output Attractivity on compact sets of initial data holds for system (1.3). This 
completes the proof of Proposition 2.5 . D 

Propositions 2.4 and 2.5 show that the discretization approach extends the classi- 
cal Lyapunov analysis, since it does not assume that a certain differential inequality 
holds for all times. However, it is important to be able to estimate accurately the 
value of the Lyapunov function along the trajectory of the solution. This disadvan- 
tage can be overcome in certain cases. 



2.9 Bibliographical and Historical Notes 

1. For proving stability by means of Fixed Point Theorems, see [7] and references 
therein. In our opinion this method of proving stability is flexible and in most 
of the cases is very similar to small-gain arguments (that are presented later in 
Chap. 5). 
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2. The notion of RFC for systems described by ODEs was introduced in [22] and 
was extended to general systems in [21, 26]. It should be noted that the notion 
of RFC implies the standard notion of forward completeness, which requires 
that for every initial condition the solution of the system exists for all times 
greater than the initial time, or equivalently, the solutions of the system do not 
present finite escape time. Conversely, an extension of Proposition 5.1 in [39] to 
the time-varying case shows that every forward complete system described by 
ODEs, whose dynamics are locally Lipschitz with respect to (r, x), uniformly 
ind e D, is RFC. A Lyapunov characterization for usual forward completeness 
for systems described by ODEs is given in [2]. 

3. The notion of URGAOS for systems described by ODEs was used in [54, 55] 
(see also [20, 36, 56, 59]). For recent results on uniform global asymptotic sta- 
bility of nonlinear and time-varying switched systems, see [38] and references 
therein. Particularly, for systems with identity output mapping, the notion of 
URGAS was used in [32, 39]. Nonuniform notions for RGAOS (and RGAS) 
were developed in [21-26, 29-31] in complete analogy with the uniform no- 
tions. Many results of the present chapter have appeared in [4-8, 13, 18] For 
systems described by RFDEs, similar notions have appeared in [4-07, [18]] 
(see also [33]). 

4. The notion of inf-convolutions (used in Remark 2.4) is studied in [11]. 

5. Differential inequalities are exploited in the book [34] (where vector differential 
inequalities are used as well). A useful comparison lemma appears in [32]. The 
reader should notice that the use of differential inequalities is a basic tool for 
the derivation of useful results for systems (see, for example, the frequent use 
of various differential inequalities in [15]). 

6. The problem of the absolute continuity of the Lyapunov functional for systems 
described by RFDEs was studied in [47, 48] (see also [24, 30, 31]). The problem 
of using a Dini derivative for the Lyapunov functional which can be estimated 
without knowledge of the solution is crucial for systems described by RFDEs: 
many times the derivatives used depend on the knowledge of the solution (see 
[17, 33, 46, 59]). We have decided to work with Dini derivatives which can be 
estimated without knowledge of the solution (because this is the big advantage 
of the Lyapunov method; see [24, 30, 31, 47, 48] as well as [13]). 

7. Excellent introductions to the method of Lyapunov functions and functionals 
for systems described by ODEs are given in [32, 53] and for systems described 
by RFDEs in [17, 33]. The books [16, 33] are classical in stability studies. 

8. Chemostat models, like the chemostat model (2.157) studied in Example 2.7.3, 
are very frequently analyzed by means of monotone system theory (see [52]). 
Usually, it is assumed that the specific growth rate for the microbial species 
is a strictly increasing, continuously differentiable, bounded function /x : 
[0, +oo) -^ [0, +oo) with m(0) = 0. 

9. The question of whether (U)RGAOS for a system implies the existence of a 
Lyapunov functional is crucial: see [3, 22, 24, 29, 39, 55, 56]. The following 
chapter is devoted to this important question. 

10. The Lyapunov method for discrete-time systems is developed in [19, 23, 25, 
35]; also see [37]. 
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1 1 . The phenomenon of "hog cycles" or nontrivial period-2 solutions (which means 
that the system is not RGAOS) for economic cobweb models like the model 
studied in Example 2.8.4, are known for a long time; see, for instance, [14]. 
The "hog cycles" have interesting economic interpretations. 

12. The "discretization approach" for Lyapunov functions was described in [1] (see 
also [32, 44, 45, 49, 50], the Appendix in [12], and the proof of the main result in 
[28]). Clearly, the discretization approach does not require a Lyapunov function 
with a negative definite derivative. Instead, the discretization approach requires 
that the difference of the values of the Lyapunov function at two consecutive 
time instances is negative. Therefore, in this approach the Lyapunov function 
can even have a positive derivative in certain regions of the state space. How- 
ever, the main difficulty in the application of this approach is the estimation of 
the difference of the values of the Lyapunov function at two consecutive time 
instances. The application of this approach to feedback stabilization problems 
gave very important results in [12] (see also recent extensions in [28]). The re- 
cent work [27] attempts the application of the discretization approach in a way 
that the difference can be estimated without knowledge of the solution map. 
The analysis in [27] shows that the discretization approach can be utilized with 
ideas that exploit higher derivatives of Lyapunov functions (see [9, 10, 60]) and 
ideas from the original theorem of Matrosov (see [51]). 

13. In the present book we will not study the Matrosov methodology of proving 
stability (see [51]). However, it should be noted that the original result by Ma- 
trosov has been generalized recently in various directions (see [40^3, 51,58]). 
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Chapter 3 

Converse Lyapunov Results 



3.1 Introduction 

This chapter is devoted to the answer of the following question: do Lyapunov func- 
tionals exist for a RGAOS system SI The previous chapter showed that one of 
the most important ways of proving stability is the derivation of estimates which 
guarantee appropriate stability properties by means of Lyapunov functionals. The 
objective of this chapter is to show that such Lyapunov functionals always exist. For 
future reference, the results demonstrating the existence of Lyapunov functionals 
are referred to as converse Lyapunov results. 

Under minimal regularity requirements, it will also be shown that the Lyapunov 
functionals have desired regularity properties. This is crucial for systems described 
by ODEs or systems described by RFDEs, since one can prove stability properties 
without knowledge of the transition map of the system. 

In what follows, E :— {X, y, Mjj , Md, 4>, it, H) denotes a control system with 
the BIC property, U — {0}, and for which e A" is a robust equilibrium point 
from the input u e Mu. Let uq e Mjj denote the identically zero input, i.e., 
Mo(f) = e C/ for all f > 0. Moreover, we assume that Hypothesis (HYP) of 
Sect. 2.6 holds. For the output map H : fR'^ x X x U —^ y, v/e assume that ei- 
ther H : ;){+ X X X U ^ y is continuous or that there exists a partition it — 
{r,}^Q of *){+ with diameter r > such that H ■.d\'^ x X x U ^ y satisfies Hy- 
pothesis (L2) in Sect. 1.7. Finally, it is assumed that for every {to,xo,di,d2) e 
Di"*" X X X Mo X Mu and for every T e 7T(to,xo, uo,di) n (ro, +oo), there ex- 
ists d e Md such that (/>(r, T,(j){T, fo, ^o, "o, di), mq, d2) — 4>(t, to, xq, uq, d) for all 
t >T and 0(?, t^, xq, uq, di) — 4>{t, ?o. ■'^O; mo> d) for all to <t <T. This assumption 
holds: 

• for systems described by ODEs under Hypotheses (Hl-4), 

• for systems described by RFDEs under Hypotheses (Sl-4), 

• for systems described by coupled RFDEs and FDEs under Hypotheses (Pl-5), 

• for systems described by FDEs under Hypotheses (Ql-3), 
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• for systems with variable sampling partition of the form (1.57) under Hypotheses 
(Al^) for which the mappings f(t, r, x, xq, u, uq, d, do) and R{r, x, xq, u, uq, 
d,do) are independent of d e D and do e D, 

• for discrete-time systems under Hypotheses (Ll-3). 



3.2 Sontag's Result on KL functions 

In this section, we present a technical result which appeared in [25] as Proposition 7 
and plays an important role in the construction of Lyapunov functionals. It is stated 
below. 

Theorem 3.1 For each a e KL, there exist a\,a2 e Koo such that a\(a{s, t)) < 
e~' a2(s) for all s,t>0. 

The proof of Theorem 3.1 depends on two technical lemmas, which show im- 
portant properties for the classes of KL and K^q functions. The following lemma is 
proved in the same way as in [25]. 

Lemma 3.1 For every a e KL, there exist ai , fl2 C ^oo such that 
a(s, t) < ai (exp(— f))fl2('5) for all s,t>0. 

Proof Without loss of generality we may assume that a{s, 0) e Koo- Otherwise, we 
may replace a e KL by ct e KL, where a(s, t) :— a(s, t) + s exp(— r). Define 

CT(s,t) 

«(0 — sup^ .^^ - (3.1) 

First notice that a : ilt"*" —>■ [0, 1] is well defined and nonincreasing. For every 
£ > 0, there exist < fl(e) < b(E) such that J' 2 < e for all x e (0, a(e)] or 
X e [b{£), +00). Therefore, from definition (3.1) we obtain, for all e > 0, 



a{t) < max 



< max 



a(s,t) 
max 



' a(e)<s<b(8) ^a(s, 0) + a^(s, 0) 
(y(b{e),t) 



(3.2) 



, ' Vcr(fl(e),0) + a2(fl(e),0), 
For every e > 0, there exists r(e) > such that 

(T{bis),t) < £[^cj{aie), O) + (J^{a(e), O)] forallr> r(e) 
Consequently, by (3.2), for all e > 0, it holds 

a(t)<s forallf >r(e). (3.3) 

Inequality (3.3) shows that lim^^+oo fl(0 — 0. Definition (3.1) implies 

ais,t)<a(t)a2(s) Vf > 0, 5 > (3.4) 
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where a2(s) :— ^(j{s, 0) + a^{s,0). Notice that inequahty (3.4) holds for i' = as 
well. We next define 



P(r) 



for r = 

a{-lnr) for re (0,1] 
a (0) for r > 1 



(3.5) 



Notice that p : di~^ -^ [0, 1] is nondecreasing with lim^^o+ /'('") — 0. By Lemma 2.4, 
there exists ai e K^o such that pis) < a\{s) for all ^ > 0. Inequality g{s, t) < 
fli(exp(— f))fl2('j) for all .v, f > is a direct consequence of definition (3.5) and 
inequality (3.4). The proof is complete. D 

The following technical lemma is proved using a different way from that in [25]. 

Lemma 3.2 For every a e Kqo, there exists p e Koo such that a(rs) < p(r)p{s) 
for all r, s > 0. 



Proof Define 



K(r):=sup 



a{rs) 



a(^ + s^) + ^/a(s) + a^is) 



for all r > 



(3.6) 



Definition (3.6) gives y(0) — 0. Moreover, for r < 1, it holds that a{rs) < a(s) < 
a(-s/s + s^) for all s > 0. Consequently, we obtain sup^^g ■ 



a(rs) 



1 < +00. For r > 1, we notice that a{rs) < a(s^) for all i' > r and a(rs) < a(^) 
for all 5 < -^ . Consequently, we have, for r > 1 , 



sup 



a{rs) 



>o a(V^+5^) + ^/a(s) +a^is) 
< max 
, fl(r2) 



a(rs) 

1 , max — r^^ — 

r-^<s<r a(^ + s^) + ^a{s) + a^(s) 



a(r-i) 



< +CXD 



(3.7) 



Therefore, the function y : di~^ -^ ili"*" is well defined and locally bounded. The 
monotonicity of a e K^q implies that y : Di"*" -^ iH"*" is nondecreasing. For all r < 1 
and e > 0, it holds that 



a{rs) 



< y/a{s) <s for all .? < a ' (e^) 



a{^ + s^) + ^a(s) +a'^(s) 

a{rs) 
ai-J^ + s'^) + y/T^ + a^{s) ~ a{s) 

The above inequalities, in conjunction with definition (3.6), imply that, for all r < 1 
and e e (0, 1), we have 



< < e for all s > a ' (e ') 
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a{rs) 



y(r) < max 



< max 






(3.8) 



It follows from (3.8) that, for all e e (0, 1) and r < "_|'p!|' it holds that y(r) < e. 
This implies that lim^^o+ K('") — 0. By Lemma 2.4, there exists ^ e ^oo such that 
Y(s) < ?{s) for all s>0. Define, for all s>0, 

p(s) := max{^(s),a{^ + s^) + ./a(s) + a^ (s)} (3.9) 

The desired inequality a{rs) < p(r)p(s) for all r, i' > is a consequence of defini- 
tions (3.6), (3.9) and the fact that y(s) < ^(s) for all s >0. The proof is complete. D 

We are now in a position to prove Theorem 3.1. Again, the proof is different from 
that in [25]. 

Proof of Theorem 3.1 By Lemma 3.1, for every g e KL, there exist p,q € Kqc such 
that CT(i', t) < p(exp(—t))q(s) for all s,t >0. Moreover, by Lemma 3.2, there exists 
b e Koo such that rs < p~^ (b(r)b(s)) for all r,s >0. Thus, we obtain, for all r > 0, 
s>0, 

p-'(^^)<expi-t) ^ b-'{cT(s,t))b-'(-^)<exp(-t) (3.10) 

\ qis) ) \qis)J 

Define ai(s) :— b~\s), a2is) :— ^ , — for ^ > 0, and 02(0) :— 0. The reader 

should notice that ai, 02 e Koo- The desired inequality ai(a{s, t)) < exp(— f)«2(.j) 
for all i', f > is a direct consequence of (3.10) and previous definitions. The proof 
is complete. D 
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The following results show that the existence of a Lyapunov functional is a neces- 
sary and sufficient condition for S to be (U)RGAOS. 

Theorem 3.2 (Lyapunov functionals) Let U :— (X,y,Mij,Mo,(l>,yt, H) be a 
control system with outputs satisfying Hypothesis (HYP) and the BIC property with 
& X as a robust equilibrium point for F. System E is RGAOS if and only if 
there exist mappings V : S){"'" x X ^- Di"*", p,y, /j. e A""*" with f^ °° y(t) dt — +cxd, 
cp & £, ai,a2 & Koo, <^nd a locally Lipschitz positive definite function p : M"*" — >■ 
Dt"*" such that for every (to,XQ,d) € ?){"*" x X x Md, there exists a constant x e 
TT{tQ,XQ, UQ,d) n [bitQ, IIxoIIa"), tQ + r], where b(t, p) :— mm{qjt{t),t + h(t, p)} is 
the function involved in Hypothesis (HYP) with (t, Iq, xq, mq, d) e A^ and the fol- 
lowing properties: 
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<3i (II H[t,(j){t, to, xq, uq, d), O) II -y + m(0 \4>it, to, xo. Mo, d) \\^) 

<V(to,xo)<a2{fi(to)\\xo\\x) Vfe[ro,T] (3.11) 

V{r,^(r,to,xo,uo,d)) < r]{r,to, V(to,xo)) (3.12) 

where rj{t, to, rjo) denotes the unique solution of the initial-value problem 



i: 



^^-y(t)p(ri) + y(t)(pU y(s)ds] )i(ro) = %>0 (3.13) 

Particularly, if system E :— {X , y , My, Mo, <p, ^, H) is RGAOS, then there ex- 
ist mappings V : M"*" x A" — >• Sit"*", /x, /S e A""*", and ai, 02 e Kca such that, for all 
{to,xo,d) e Of"*" X X X Mo andx eTT{to,xo, uq, d), properties (3.11), (3.12), (3.13) 
are satisfied with rj(t, to, s) :— exp(— (? — to))s, p(s) :— s, y(t) = 1, and (p{t) = 0. 

Proof Suppose first that T := (X, y. Ma, MD,(p,7t, H) is RGAOS. Then by state- 
ment (ii) of Theorem 2.1, there exist functions jjl, P e K^ and a e KL such that for 
every {to, xo, d) e Di"*" x X x Mo, we have 

\\H (^t , (pit , to, xo, uo, d), 0)\\y -\- p,(t)\\(p(t, to,xo, uo,d)\\-^ 

<(r{p{to)\\xo\\x,t-to) forallr>fo (3.14) 

Moreover, by recalling Theorem 3.1, there exist functions ai, aj of class K^q such 
that the KL function a(s, t) is dominated by flj~ (exp(— 2f)a2(>j))- Combining the 
previous observations with estimate (3.14), we obtain the following estimate for all 

{to, Xo, <i) e S){+ X A" X Mo'- 

a\ (II H{t,(j){t, to, xo, MO, cf), 0) II -y + /x(f) !</)(?, to, xo, mo, d) \.^) 

<exp(-2(r-fo))fl2(;6(fo)lkollA') forallf>fo (3.15) 

We define, for all {to, xo) e i)J+ x X, 

V{to,xo) := sup{exp(f-fo)«i (II ^(?, </>(?, ro,J^o,«o,<^), 0)1-^ 

-^ p.{t)\(p{t , to, Xo, uo, d)\ ^); t>to,de Mo] (3.16) 

It is immediate to verify that definition (3.16), in conjunction with estimate (3.15), 
guarantees that inequality (3.11) holds for all {to,xo,d) e M"*" x X x Mo and 
r e jt{to,xo,uo,d). Moreover, by virtue of definition (3.16) and the hypoth- 
esis which guarantees that for every {to,xo,d\,d2) e DJ"'" x A:" x Mo x Mo 
and for every T e 7r{to,xo,uo,di) fi {to, +00), there exists d e Mo such that 
4>{t, T, 4>{T, to, Xo, mq, di). Mo, dj) — 4'{t, to, xo, mo, d) for all f > T and (/;(?, to, xo, 
uo,di) — (t){t,to,xo,uo,d) for all to < t < T , il follows that inequality (3.12) 
holds with ri{t, to, s) :— exp(— (f — to))s for all {to, xo, d) e Di"*" x X x Mo and 
r e TT{to,xo,uo,d) (and consequently, (3.13) holds for p{s) :— s, y{t) = 1, and 
^(0 = 0). 

The rest of the proof is a consequence of Theorem 2.3. The proof is complete. D 
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Theorem 3.3 (Lyapunov functionals) Let E :— (X,y,Mij,M[),<l>,yt, H) be a 
control system with outputs satisfying Hypothesis (HYP) and the BIC property with 
Q & X as a robust equilibrium point for E . Moreover, suppose that S is RFC. Sys- 
tem E is URGAOS if and only if there exist mappings V : DJ"*" x <¥ — >• Sit"*", oi, fl2 e 
Koo, and a locally Lipschitz positive definite function p : Dt"*" — >• Dt"*" such that for 
every (to, xq, d) e Jit"*" x X x Md, there exists r e :r(fo, xq, uq, d) n [b(to, \\xq\\x), 
to + r], where b(t, p) :— min{g,j(;), t + h(t, p)} is the function involved in Hypoth- 
esis (HYP), with (r, Iq, xq, uq, d) e A^ and the following properties: 

ai (II H{t,(P(t, to, xo, UQ, d), 0) \y) < V(tQ, xq) < a2{\\xQ\\x) Wt e [?o, r] (3.17) 

V {r, (pit, tQ, XQ, UQ, d)) < r]{r, tQ, V (tQ, xq)) (3.18) 

where rj{t, tQ, tjq) denotes the unique solution of the initial-value problem 

)7 = -p()7), )7(fo) = TO > 0. (3.19) 

Particularly, if system E :— (X, y, Mu , Mo, 4>, it, H) is URGAOS, then there exist 
mappings V : !){"*" x A" — >• Sit"*" and a\,a2 e K^a such that for all (tQ, xq, d) G Sit"*" x 
X X Mo and r e JT(to, xq, uq, d), properties (3.17), (3.18), (3.19) are satisfied with 
r](t, tQ,s) :— exp(— (r — tQ))s and p(s) :— s. 

Proof Suppose first that E -.^ (X,y, Mu, Mo,(t>,7t, H) is URGAOS. Then by 
Theorem 2.2, there exists a function ct e KL such that for every (tQ,XQ,d) e 
SH+ X X X Mo, we have 

\\H{t,(P(t,tQ,xo,UQ,d),0)\\y<a{\\xQ\\x,t-tQ) Wt>tQ (3.20) 

Moreover, by recalling Theorem 3.1, there exist functions ai, aj of class Koo such 
that the KL function a(s, t) is dominated by a~^ (e,x^(—2t)a2(s)) . Combining the 
previous observations with estimate (3.20), we obtain the following estimate for all 
(tQ, XQ, d) e ;H+ X X X Mo'- 
ai{\\H{t,(l)(t,tQ,XQ,uo,d),0)\\y) <sxp{-2(t -tQ))a2{\\xQ\\;^) Wt>tQ (3.21) 

We define, for all (tQ, xq) e di+ x X, 

V(tQ,XQ) 

:— sup{exp(f - tQ)ai{\\H (t , (l)(t , tQ, XQ, UQ, d) , 0)\\y) :t>to,de Mo} (3.22) 

It is immediate to verify that definition (3.22), in conjunction with estimate (3.21), 
guarantees that inequality (3.17) holds for all (ro, XQ,d) e Ot"*" x X x Mo and r e 
Jt(tQ, XQ, UQ, d). Moreover, by virtue of definition (3.22) and the hypothesis which 
guarantees that for every (fo, xo,di, d2) e St"'" x X x Mo x Mo and for every T e 
jT(tQ,XQ,uo,di)r\ (to, +oo), there exists d e Mo such that 

(/>(?, T, (p(T, tQ, Xq, Uq, di), Uq, (^2) — <P(t, tQ, Xq, Uq, d) for all ? > 7" 
(p(t, tQ, Xq, Uq, di) — (l)(t, tQ, Xq, Uq, d) for ^\tQ <t <T 

it follows that inequality (3.18) holds with ri(t,tQ,s) :— exp(— (f — to))s for all 
(tQ,XQ,d) e iW"*" X X X Mo and r e 7T(tQ,XQ,uo,d). Consequently, (3.19) holds 
for p(.s') :— s. 

The rest of the proof is a consequence of Theorem 2.3. The proof is complete. D 
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Since Lemma 2.7 shows that RFC for S := (A", 3^, My, Mo, 0, tt, H) is 
equivalent to RGAOS for system Z :— (X,y,Mu,MD,4>,7T,H) with output 
H(t, X, u) :— fjL{t)x, where /z e K~^ is the function involved in inequality (2.56), 
the following corollary follows readily from Theorem 3.2. 

Corollary 3.1 Suppose that the control system E :— {X,y, Mu, M[),4>,7T, H) 
with outputs satisfies Hypothesis (HYP) and the BIC property, and € A" is 
a robust equilibrium point for E. System E is RFC if and only if there exist 
mappings V : m+ k X ^ 9i+, P,y,fJ, e K+ with /o+~ Y(t)dt = +oo, (p e £, 
01,02 C ^oo, <3«rf a locally Lipschitz positive definite function p : !){"*" — >• 5)^"*" 
such that for every (fo, xq, d) e 91''" x A:" x Mo, there exists x e 7r(fo, xq, uq, d) n 
[b{tQ, \\xQ\\x),tQ + r], where b{t,p) :— mm{q„(t),t + h{t,p)} is the function 
in (HYP), with (r, to, xq, mq, d) e A^ and the following properties: 

a\{tJi(t)\(l){t,to,XQ,UQ,d)\^) < V{,tQ,XQ)<a2{P{to)\\xo\\x) Vr e [fo, t] (3.23) 
V{r,(l)ix,to,xo,uo,d)) <ri{x,to,V{to,xo)) (3.24) 

where rj{t, to, rjo) denotes the unique solution of the initial-value problem 



/; 



il^-Y{t)p(ri) + Y(tM\ Y{s)ds\ )?(fo) = %>0 (3.25) 

Particularly, if system E :— (X ,y , Mu , Mo,4>,tx, H) is RFC, then there exist 
mappings V : Sit"*" x A — >• Di"*", /U, /J e K'^, and a\,a2 e Koo such that for every 
(to, xo, d) e S)}"*" X A X Mu and x e 7t(to, xo, mo, d), properties (3.23), (3.24), (3.25) 
are satisfied with rj{t, to, s) :— exp(— (? — to))s, p{s) :— s, y(t) = 1, and (p{t) = 0. 

Remark 3.1 Theorems 3.2, 3.3, and Corollary 3.1 are existence-type results which 
do not provide ways of "finding" such a Lyapunov functional. Moreover, they do 
not guarantee regularity properties for the Lyapunov functionals. On the other hand. 
Sect. 2.6 showed that the existence of Lyapunov functionals with certain regularity 
properties is crucial for establishing RGAOS without knowing the evolution map of 
the system (for certain types of systems). Consequently, the question of the existence 
of a Lyapunov functional with certain regularity properties becomes important, and 
the following section is devoted to its answer. 
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In this section we consider a control system E :— (A, y. My, Mq, 0, it, H) with 
the BIC property and for which e A is a robust equilibrium point from the 
input u e Mu. We assume that Hypothesis (HYP) of Sect. 2.6 holds and that 
E := (A, 3^, Mu,Md, (/>, Tt, H) is (U)RGAOS. Furthermore, we will employ one 
of the following hypotheses: 
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(REGl) For every pair of bounded sets / C SH'*', S C X and for every e > 
0, there exists S > such that \\H{t,(l){t,to,x,uo,d),0) — H(t,(j){t,to,xo, 
uo,d),Q)\\y < s for all tj^e I,d e Mo, x,xoe S with \\x — xqWx < S,t > Iq. 

(REG2) For every pair of bounded sets / C SH"*", S C X, there exists L > such 
that \\H (t , ^{t , to, X , UQ, d) , 0) — H (t , (p{t , to, xq, uq, d) , 0)\\y < L\\x — xqWx for 
all t,toe I,d e Mo, x,xoeS with t > to. 

(REG3) There exist sets X^ C. X parameterized by 1 > and a nondecreas- 
ing function P : Dt"*" —!^ [l,+oo) satisfying that for every pair of bounded 
sets / C Ot"*", S (Z X, there exists a constant L > such that \\H(t,(l){t,to,x, 
uo, d) , 0) — H {r , (j)(r , to, X , uo, d) , 0)\\y + {{(pit , r , X , uo, d) — x\\x <LP(X){t — r{ 
for all t, x,to e I, d e Mo, x e Xx (^ S with t > x > to- Moreover, for all 
{to,xo,d) e SH"*" X X X Mo, it holds that 7T(to,xo,uo,d) — [to,+oo) (i.e., the 
classical semigroup property holds). 

It is clear that (REG2) implies (REGl). Later in this section we will show that 
systems described by ODEs, systems described by RFDEs, and discrete-time sys- 
tems satisfy some of the Hypotheses (REGl-3). We now proceed to the construction 
of a Lyapunov functional which exploits Hypotheses (REGl-3). 

By Theorem 2.1 (or Theorem 2.2) there exist functions /J e K~^ and a e KL such 
that for every (to, xo,d) e DJ"*" x X x Mo, we have 

\\H{t,(l>(t,to,xo,uo,d),Q)\\y<cj{Pito){{xo{{x,t-to) Vr>ro (3-26) 

The reader should notice that in the case of URGAOS we have Pit) = 1. More- 
over, by recalling Theorem 3.1 there exist functions ai , 02 of class Koo such that the 
KL function cr(i, t) is dominated by aj~ (exp(— 2r)a2('S))- Thus, taking into account 
estimate (3.26), we have, for all (to, xq, d) e di~^ x X x Mo and t > to, 

5i(|| //(f, 0(f, to, xo, uo, d)) \y) < exp(-2(f - ro))52(;S(ro)||xo||A') (3.27) 

Without loss of generality we may assume that a 1 e Koo is globally Lipschitz on St"*" 
with unit Lipschitz constant, namely, {a\ (si ) — 01(^2) I < ki — ■s'2 1 for all s\,S2> 0. 
To see this, notice that we can always replace en e Koo by the function ai(s) :— 
inf {2 1 (y)+{y — s{;y>0}, which is of class Koo , globally Lipschitz on SH"*" with unit 
Lipschitz constant, and satisfies ai(s) < ai(s). Moreover, without loss of generality 
we may assume that /S e A""*" is nondecreasing. 

We define for all g e N, where N is the set of natural numbers: 

Uq(t,x):— sup{max{0,fli(||//(T,(/)(r, t,x, uo,d))\y) — q~^\ 

exp((T-r)) :T>f,cfeMz)} (3.28) 

It should be noted that if E :— (X,y, My, Mo,(l>,7t, H) is T-periodic, then 
Uq : di+ X X ^m+ is r-periodic and if U := (X, y, Mu, Mo, (j), it, H) is au- 
tonomous, then Uq : S)}"*" x X ^ Di"*" is independent of f e di~^. Clearly, we obtain 
from estimate (3.27) and definition (3.28) that 
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max{0, fli (II H(f, x)\\y) -q~^}< Uq{t, x) < 52{P(t)\\x\\x) 

'i(t,x,q)edi+ X X xN (3.29) 

Moreover, by virtue of definition (3.28), the weak semigroup property, and the hy- 
pothesis which guarantees that for every (Iq, xq, d\ , dj) e M"*" x X x Mo x Md and 
for every T e7T(tQ,XQ,uo,di)r[{t(}, +oo), there exists d e Mo such that 

</>(?, T , (j){T , to, XQ, UQ, di), UQ, d-i) — (pit, to, XQ, uq, d) Vt >T 

4>{t, tQ, xq, uq, di) — (j){t, to, xq, uq, d) WtQ <t<T 

we obtain, for all (t, x, q) e SH"*" x X xN, d e Mo, and x en{t, x, uq, d), 

Ug{r,(t>ir,t,x,UQ,d)) < exp(-(r - r))C/g(r,x) (3.30) 

By estimate (3.27) it follows that for all (q, R)eNx M+, r > f + f (/?, q), (t, d) e 
[0, R] X Mo, and x eX with \\x \\x < R, it holds that 

5i(||//(t, (/)(r, t, X, Mo,^))!^) < exp(-2(r - t))a2{P(t)\\x\\x) < q~^ 

where 

f(R, q) := ^ log(l + q~a2{P{R)R)) (3.31) 

Thus, by virtue of definitions (3.28) and (3.31), we conclude that 

Uq{t,x) — sup{max{0,fli(||i/(T, (/)(t, t,x,uo,d))\\y) — ^~'}exp((r — ?)) : 

t <r <t + ^,deMo} W^>f{m£Lx{t,\\x\\r},q) (3.32) 

Equality (3.32) implies the following inequalities for all t e [0, R] and (x, y) e 
X X X with 11x11;^ < R, \\y\\x < R- 

\Ugit,y)-Uq(t,x)\ 
— I sup{max{0,ai(||//(T,(/)(r, t, y,uo,d))\\y) — ^~'}exp((r — t)) : 
t <x <t + f{R,q),deMo] 
— sup{max{0, ai(||H(r, (p(r,t,x, UQ,d)^\\y) — ^~'}exp((r — r)) : 

t <r <t+f(R,q),deMo}\ 

< sup{exp((T - 0) |ai(|| //(t, 0(r, t, y, uq, d)) \\ y) 

- 5i (II H{r,(P(r, t, X, uo,d))\\y)\:t<r<t + f(R, q), deMo] 

< sup{exp((T — tj) II ^(t, (l>(r,t, y,uo, d)j — //(r, ^(r, f,x, UQ,d)) \\y : 

t <r <t + f{R,q),deMo} (3.33) 

Notice that in the above inequalities we have used the facts that the functions 
maxjO, s — q~^} and ai(s) are globally Lipschitz on Sit"*" with unit Lipschitz con- 
stant. 
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Thus we are ready to use inequality (3.33) in order to establish certain properties. 

(1) If Hypothesis (REGl) holds, then for every pair of bounded sets / C di~^, 
S C X and for alls > 0,q e N, there exists S > Q such that \Uq(t, y) — Uq(t,x)\ < s 
for all r e / and x, y e S with ||.^ — yll a" < S. In this case, define 

00 

V(t,x):^J2^-iUq(t,x) (3.34) 

9 = 1 

Clearly, definitions (3.28), (3.34) and inequality (3.29) imply the existence of func- 
tions a\,a2 e K^o such that, for all (t,x) e Dt"*" x X,d e Md, 

&upai{\\H{r,(pir,t,x,uo,d),0)\\^) < Vit,x) <a2{P(t)\\x\\x) (3.35) 

Particularly, we have a2(s) :— d2(s) and ai(s) :— ^^i 2~^ max{0,ai(i') — q~^} 
(the reader should notice that aj e Koo). Moreover, inequality (3.30), in conjunc- 
tion with definition (3.34), implies that, for all (t,x) edl'^ x X, d e Mr, and 

r e n(t, x, uq, d), 

V{r,(t>(r,t,x,UQ,d)) < exp(-(r - r))y(r,x) (3.36) 

Furthermore, if F := {X, y,Mu,MD,(p,7T, H) is T-periodic, then V ■.'i)\+ xX^ 
Sit"*" is T-periodic, and if iJ :— (X, y, Mfj, Mo, 4>, Tt, H) is autonomous, then V : 
Dt"*" X X —^ S)}"*" is independent of f e di'^. Take arbitrary bounded sets / C S)}"*", S C 
A'ande > 0. Clearly, there exists an integer A^ > 1 suchthatfl2(yS(0lkllA')2~^ < | 
for all f e /, X e S. It follows from (3.29) that 

OO 00 

Y] 2-'iUgit,x)<d2{P(t)\\x\\x) Yl 2-1 <- forallf e/,jce5 

q=N+l q=N+\ 

Consequently, (3.34) implies that \V(t,x) - V{t,y)\ < § + E^=i 2"^l^<?(^ ■«) - 
Uq{t,y)\ for all f e / and x,y e S. Moreover, there exists ^ > such that 
\Uq{t,y) — Uq(t,x)\ < ^ fox SiW t el, x,y eS,q — \,...,N with \\x — y\\x < S. 
Finally, we obtain the following property: 

For every pair of bounded sets / C Slf"*", S C X and for every e > 0, there exists 
S > such that \V(t,y)- V(t,x)\ < e for all f e / andx, v e 5 with ||x-)'||;t' < S. 

(2) If Hypothesis (REG2) holds, then there exists a function G : ;)i+ x N ^ 9J+ 
with G(q, q) > G(R, q) for a[lq>R and such that for all /? > 0, f e [0, R], q eN, 

and (x,y) e X X X with \\x\\x < R, \\y\\x < R, it holds 

\Uqit,y)-Uq(t,x)\<G{R,q)\\y-x\\x (3.37) 

Particularly, if L(R) is a nondecreasing, nonnegative function satisfying the prop- 
erty that \\H(t,(t)(t, to, X, MO, d), 0) - H(t, (j){t, to, y, uo, d), O)!!^ < L(^)||jr -y\\x 
forallf,ro e [0, R],d e Md, (x,y) e A:'x A" with ||;c||;v' < R, \\y\\x < i^andf > to, 
then we can define 

G{R, q) := L{R + f(R, q)) exp{f(R, q)) (3.38) 
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In this case, introduce 

^ l + Giq,q) 

Clearly, definitions (3.28), (3.39) and inequality (3.29) imply the existence of func- 
tions a\,a2 e A'oo such that (3.35) holds (particularly, we have a2(s) :— a2{s) and 
ai(s) :— X!o^i ^~^ mjx| ai(.s)-i? — j^ Moreover, inequality (3.30), in conjunction 
with definition (3.39), impHes that (3.36) holds for all (f , x) e M+ x <¥, c? e Mq, and 
r e Tc{t, X, UQ, d). Furthermore, if S :— (X, y, Mjj , Mo, 4>, Jt, H) is T-periodic, 
then V -.m+^X^ J){+ is T-periodic, and if S := {X, y, My , Md,(I),tt, H) is au- 
tonomous, then V : S){+ x X ^ di~^ is independent of f e di^. Finally, for all R>0, 
t e [0, R], and (x,y)eX x X with ||x||;t' < R, \\y\\x < R, it follows from (3.37) 
that 



Vit,x)-Vit,y) <^2-'? ' '\\'. '\'"' 
^ l + G{q,q) 




<\\y- 



Consequently, we have established the following property: 

There exists a nondecreasing function M : St"*" —>■ Sit"'" such that for all t e [0, R] and 
ix,y) e X X X with \\x\\;c < R, \\y\\x < R, it holds 

\V(t,y)-V(t,x)\ <M{R)\\y-x\\x (3.40) 

(3) If Hypotheses (REG2) and (REG3) hold, then there exists a function G : 
dl+ xN-^ d\+ with G(q,q)>G(R,q) for all ^ > 7? and such that, for all R>0, 
t e [0, R], q eN, and ix,y)eXxX with ||x||^ < R, \\y\\x < R, inequality (3.37) 
holds. 

Let R,X> 0, q e N arbitrary, ti,t2 e [0, R] with ti < t2, and x e Xx with 
\\x \\x ^ R- Clearly, we have, for all d e Mo, 

\Ugiti,x)-Ugit2,x)\<{l-exp{-(t2-h)))Ugiti,x) 

+ \exp{-(t2 - ti))Uq(tl , X) - Uq{t2,(t>(t2,ti,X,U0,d))\ 
+ \Uq{t2,(l){t2,tl,X,U0,d)) - Uq(t2,x)\ (3.41) 

Since S is RGAOS (and consequently RFC), Lemma 2.7 implies that there exist 
functions /z e K~^ and d e Koc such that for every (to, xq, d) e Ot"*" x X x Mo, we 
have 

\\(p{t,to,xo,UQ,d)\\.^<fi(t)d{\\xo\\x) Vr > ro (3.42) 
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Without loss of generality, we may assume that // e K'^ is nondecreasing. By virtue 
of (3.37), (3.30), (3.41), and (3.42), we obtain, for all fi, ^2 e [0, R] with ti < t2 and 
d e Mo, 

\Uq(tux)-Uq(t2,x)\ <it2-tl)Uq(tl,x)+eXp{-(t2-tl))Uq(ti,x) 
- Uq{t2,(t)(t2,tl,X,U0,d)) 

+ G{fi(R)a{R), q)L(R)P(X){t2 - h) (3.43) 

where L{R) > Ois a nondecreasing function satisfying ||//(f, </>(?, fo,-*', "O: i^), 0) — 
H{r,^(r,to,x,uo,d),0)\\y+ \\(t)(t,x,x,uo,d) -x||;t' < L(R)P(X)\t - r| for all 
t, T, to e [0, R], d e Md with t > r > to, and x e X}, with ||x||^ < R. Defini- 
tion (3.28) implies that for every e > 0, there exists dg e Mo with the following 
property: 

Uq{ti,x) — s < sup{max{0,ai(||//(r,(/)(r, ti,x,uo,de)^\\y) — q~^} 

exp((r - fi)); r >fi} < Uqiti,x) (3.44) 

Thus, using definition (3.28) and (3.44), we obtain 

exp(-(f2 - tl))Uq(tl,x) - Uq(t2, 0(^2, t^X, MQ, dg)) 

<m&x[Aq(tut2,x), Bq{ti,t2,x)] - Bq(tx,t2,x) + E&Xp{-{t2- ti)) (3.45) 

where 

Aq{ti,t2,x) := sup{max{O,fli(||//(r,0(T,fi,x,Mo,4))||3;) -?"'} 

exp((r-r2));f2>T>?i} 
Bq(ti, t2,x) :— sup{max{0, d[{^\\H{^t,(p(r,ti,x,uo,dg))\\y) — q~ j 

exp{(r -t2));r>t2} 



(3.46) 



Since the functions max{0, s — q '} and ai (s) are globally Lipschitz on Bi"*" with 
unit Lipschitz constant, we have 



<sup{max{0, ai(||//(r, ^(r, fi,x,Mo,4))||y) -q '}exp((r -^2)); 



Aq(tl,t2,x)- Bqitl,t2,x) 

t2>r >ti} -max{0,ai{\\H{t2,(p(t2,ti,x,uo,dg))\\y) -q~^} 

< sup{max{0, fli(||//(r, 0(r, ri,x,Mo,'^£))||3;) - q~^};t2>r >ti] 
- max{0, di{\\H {t2, (p(t2, t[, X , uo, dg))\\y) - q~^} 

<sup{\di{\\H{r,(l)(r,ti,x,uo,dE))\\y)-d[{\\H{t2,4>(t2,h,x,uo,dg))\\y) 
?2 > T > ?i } 

< sup{ II H[x,(p{r, ti,x, Mo, dg)) - // (f2 , </> (^2 , h,x, mq, dg)) \\y; t2>r>ti} 



(3.47) 
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Distinguishing the cases Aq{ti,t2,x) > Bq(ti,t2,x) and Aq{ti,t2,x) < 
Bq {h ,t2,x),ii follows from (3.45) and (3.47) that 

ex^{-{t2-ti))Uq{ti,x)-Uq{t2,(j){t2,t\,x,uo,d,))<L(R)P(X){t2-ti) + e 

where L{R) > Ois a nondecreasing function satisfying \\H {t , (j){t , t^, x , uq, d) ,0) — 
H{x,(p{x,tQ,x,UQ,d),Q)\\y+ ||(/>(f, r,x,uo,d) - x\\x < LiR)P(X)\t - r| for all 
t, r, to e [0, R], d e Mo with t>x>tQ, and x eXx with \\x\\x < R- Combining 
the above inequality with (3.43) and the right-hand side of (3.29), we obtain 

\Uq(tl,x)-Uq(t2,x)\ 

< {t2 - ti)P(X){a2{P(R)R) + L(R) + L{R)G{fi{R)5(R), q)) + e (3.48) 

Since (3.48) holds for all e > 0, R, \ > 0, q e N, x e X^, with ||x||^ < R, and 
ti,t2 e [0, R] with ti < t2, it follows that for all R, X >0, q eN, x e Xi with 
\\x\\x < R, and ti, t2 e [0, R], 

\Uq(n,x)-Uq(t2,x)\<\t2-ti\P(X)GiR,q) (3.49) 

where G(R, q) := a2(fi(R)R) + L{R) + L(R)G(ii(R)a(R), q). Finally, we define 

2-Wq{t,x) 

G(q,q) + G(q,q) 



V(f,x):=V ^-^^^ (3-50) 



Clearly, definitions (3.28), (3.50) and inequality (3.29) imply the existence of func- 
tions a\,a2 e A'oo such that (3.35) holds (particularly, we have a2{s) :— a2(s) and 
ai(s) :— Y1T=[ 2~^ Tr{ '" '^'^ — -)■ Moreover, inequality (3.30), in conjunction 

with definition (3.50), impHes that (3.36) holds for all (f,x) e i1t+ x A", J e Md, 
and X >t. Furthermore, if E :— (X,y, My, Md,(P,7T, H) is T-periodic, then 
V :m+ X X ^ d\+ is r-periodic, and if E := (X, y, Mu, Md,^, tt, H) is au- 
tonomous, then V : iW"*" x X —^ Sit"*" is independent of r e di~^. Similarly, as in 
the previous case, we may establish that property (3.40) holds. Finally, by virtue 
of (3.49) and definition (3.50), we obtain, for all R,k>0,x eXx with \\x\\x < R, 
and f 1,^2 e [0, R], 



oo 



\Vit2,x)-V(tux)\<J2—^ 



2-1\Uqit2,x)-Uq(tl,x)\ 



^^1 ' • G(q,q) + G{q,q) 

2-lG{R,q) 



<\t2-tl\P{X)Y,- 



. + G{q,q) + G{q,q) 

q i 

/[«] + ! 



2-'iG{R,q) 
V frt ^ + G{q,q) + G{q,q) 

Therefore, we have shown almost all conclusions of the following theorem. 



<\t2-n\Pix){j: ^^"^"'!^ +1 

\ ^ 1 + G(fl,fl) + G(a,fl) 



Theorem 3.4 (Lyapunov functionals) Suppose that Z :— (X, y, Mu , Md, 4>,tt, H) 
is a control system with outputs satisfying Hypothesis (HYP) and the BIG property 
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with e X as a robust equilibrium point for U . Moreover, suppose that system S is 
RGAOS. Then there exist mappings V : ?R'^ x A" — >■ Ot"*", P e K'^ , and ay, 02^ K^o 
such that for all (to, xq, d) e SJi"*" x A' x Md and x e Jt(tQ, xq, uq, d), the following 
inequalities hold: 

ai{\H{t,(j){t,tQ,XQ,ua,d),Q)\y) < Vito,xo)<a2{P(tQ)\\xo\\x) 

V?e[fo,T] (3.51) 

V{r,(l){r,to,xo,uo,d)) < sxp{-{r - to))V (to, xq) (3.52) 

Moreover, if system E is URGAOS, then (3.51) holds with P(t) = 1. Furthermore, 

(i) If Hypothesis (REGl) holds, then for every pair of bounded sets I C Oi"*", S C 

X and for every e > 0, there exists S > such that \V(t, y) — V (t , x)\ < s for 

all t e I and X, y e S with \\x — y\\x < S. 
(ii) If Hypothesis (REG2) holds, then there exists a nondecreasing function M : 

f){+ -^ M+ such that for all R>0,t e[Q, R], and ix,y) eXxX with \\x\\x < 

R^ \\y\\x S R, it holds that 

\Vit,y)-Vit,x)\<M(R)\\y-x\\x. (3.53) 

(iii) If Hypotheses (REG2) and (REG3) hold, then there exists a nondecreasing 
function M : ;)i+ —^ S)i+ such that for all R, k > 0, ti,t2 e [0, R], and x G 
X^C^ X with \\x\\x < R, it holds that 

\V{t2,x)-V{tux)\<M{R)P{X)\t2-ti\. (3.54) 

Moreover, if the set U;v>o ^■^ '■^ dense in X , then V : SH"*" x A" — >• Sit"*" is contin- 
uous. 

Finally, if S := {X, y, Mu,MD,(t>, Jt, H) is T-periodic, then V ■.'i)\+ x X ^ S}t+ 
is T-periodic, and if E :— {X, y, Mjj , Mq, (p, jt, H) is autonomous, then V : Sit"*" x 
X — >• Dt"*" is independent ofte SM"*". 

Proof We only have to show the continuity of V : SH"*" x X ^ ilt"*" with respect 
to r e Di"*" for the case where (REG2) and (REG3) hold and under the additional 
hypothesis that the set U;ii>o ^^ ^^ dense in X. Let {to, xo) e di~^ x X, s > 0, and 
define R :— ||xo||^ + f + 2. Since the set U;i>o^^ ^^ dense in X, there exist X>0 
and X e Xx c. X such that 



\\x — xqIIa' < mm 



1 



[4(1 + M(R))' 

where M : S)?"*" -^ ilt"*" is the nondecreasing function involved in (3.53). Conse- 
quently, using (3.53), (3.54), and the above inequality, we have, for all t e Di"*" with 
\t-to\<l, 

\V{t,xo)-Vito,xo)\ < \V{t,xo) - V(t,x)\ + \V{t,x)-V(to,x)\ 

+ \V(tQ,x)-V{to,xo)\ 

< 2M{R)\\x - jcoIIat + M(R)P(k)\t - ?ol 

<^- + M(R)P(X)\t-to\ 
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It follows that \V{t,xo) - V(to,xo)\ < s for all t e S)i+ with \t - to\ < 
™"{ 2a+M(R)P(X)) ' 1 ' ■ "^^^ proof is complete. D 

The result of Theorem 3.4 can lead to the production of specialized results for 
three kinds of systems of Definition 1.1. 



3.4.1 Control Systems Described by ODEs 

We start by presenting a general Lyapunov theorem for systems described by ODEs 
of the form (1.3) under Hypotheses (Hl^). We assume that system (1.3) under 
Hypotheses (Hl-4) is RGAOS. 

Clearly, inequality (1.2) guarantees that Hypothesis (REG2) holds if in addition 
we further assume that H : di'^ x di" -^ Slt*^ is locally Lipschitz and independent of 
u e U. Moreover, the fact that 

(j){t, to, X, uq, d) — X + I f(^s,(p{s, to, X, uq, d),0,d{s))ds 

Jto 

implies that \4>{t, to, x, mq, d) — x\ < (t — to) max,(,<.s<? y{s)a(iJ.(s)a(\xo\y), where 
y e K~^ and a e K^c are the functions involved in Hypothesis (H4), and /i e K'^ 
and a e Kqc are the functions involved in (3.42). This observation combined with 
the fact that H : Dt"*" x Di" — >• ^i^ is locally Lipschitz implies that Hypothesis (REG3) 
holds as well with Xx = di" for all A > 0. 
Therefore, we obtain the following: 

Theorem 3.5 Consider system (1.3) under Hypotheses {HI— 4) and suppose that 
H : JH"*" X J)i" — >• S)i is locally Lipschitz and independent of u e U . Furthermore, 
suppose that (1.3) is RGAOS and that the following hypothesis holds: 

(H5) There exists a countable set A C St"*", which is either finite or A — {t^', k — 
1, . . . , oo} with tic+i > tk > Q for all k — 1,2, .. . and limtk — +oo, such that 
the mapping (t,x,u,d) e (S){"'"\A) x di" x U x D ^ f(t,x,u,d) is contin- 
uous. Moreover, for each fixed (to, x, u,d) e di^ x di" x U x D, we have 
lun^^^+ f(t, X, u, d) — f(tQ, X, u, d). 

Then, there exist functions V : Di"*" x di" — >• DJ"*", which is locally Lipschitz, P € K'^ , 
and a I, 02 € K^^ such that the following inequalities hold: 

ai{\H(t,x)\)<V{t,x)<a2{P(t)\x\) V(f,x) e !){+ x Dt" (3.55) 

V°{t,x; f(t,x,0,d))<-V(t,x) 'i(t,x,d)em+ xm" X D (3.56) 

where V°it,x;v) is defined in (2. 128)/or all v e i)i" . Moreover, if (1.3) is URGAOS, 
then P(t) = 1. Finally, if (1.3) is T-periodic, then V : iW"*" x A" — >• Dt"*" is T -periodic, 
and if (1.3) is autonomous, then V : Dt"*" x A:" — >• Dt"*" is independent oft e Dt"*". 
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Proof By Theorem 3.4, there exist mappings V : !]{"'" x !){" -^ di'^, which is locally 
Lipschitz, /S e K'^, and a\,a2e Kqc such that for all (t, x,d) ed^'^ x !1{" x Md and 
r > f , (3.55) holds and the following inequality holds: 

V{r,(t>(r,t,x,UQ,d)) < exp(-(r - f))y(f,x) (3.57) 

The conclusion of the theorem is a direct consequence of the following fact: 

Fact lim^^,+ '^^'^■^-';"°''^^~-' = f(t, x, 0, d(t)) for every continuous deMo- 

Indeed, by letting d{t) = d e D it follows from the above fact and (3.57) that 
(3.56) holds for all {t,x,d) ed\+ x d\" x D. 

The above fact is a direct consequence of Hypothesis (H5). It is clear that 
for every continuous d e Mo, the composite map f{r,x,0,d(r)) is continuous 
on (9{"'"\A) X Dt". Applying repeatedly Theorem 2.1 (p. 43) in [9] on each one 
of the intervals contained in [f , +cxd)\A, we conclude that the solution x{r) — 
4>{t, t,x, U(j,d) of (1.3) satisfies x(r) — f{x,x{x), 0, dir)) for all t e [t, +oo)\A. 
Since the composite map r -^ f{r, x, 0, d(r)) is right-continuous on Dt"*", by virtue 
of the mean value theorem, it follows that hm/,^o+ ^'•''^'^j^~-'^'-''> — f(t, x, 0, d(t)) for 
all r e [t,+oo). 

The proof is complete. D 



3.4.2 Control Systems Described by RFDEs 

We continue by presenting a general converse Lyapunov theorem for systems de- 
scribed by RFDEs of the form (1.10) under Hypotheses (S 1^). It is further assumed 
that (1.10) is RGAOS and that the following hypothesis holds: 

(S5) The mapping H{t,x, u) is independent of u e U and Lipschitz on bounded 
sets, in the sense that for every bounded / C 9{+ and for every bounded S C 
C*'([— /", 0]; di"), there exists a constant Lh > such that 

\\H{t,x) - Hit, y)\\y <LH{\t-r\+ \\x - y\\r) 
V(r,T)e/ X I,W(x,y)eSx S 

Hypothesis (S5) is equivalent to the existence of a continuous function Lh '■ 9i~^ x 
Dt"*" -^ !){"*" such that for each fixed f > 0, the mappings Lfiit, ■) and L//(-, t) are 
nondecreasing, with the following property: 

||7/(r,x)-H(r, 3^)1-^ <L//(max{f,r}, \\x\\r + \\y\\r){\t-r\ + ||x-y||^) 

V(r, T, X, y) e i)i+ X i)i+ X C^{[-r, 0]; M") x C^{[-r, 0]; i)J") (3.58) 

Inequality (1.9), in conjunction with Hypothesis (S5), implies that Hypothe- 
sis (REG2) holds. Moreover, Hypothesis (REG3) holds as well with X^ being the 
set of absolutely continuous functions x : [—r, 0] -^ S1{" with supg^r^ gi \x{9) \ < k. 
Indeed, the fact that 
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<p(t, tQ, X, uq, d) 

x(G) + //^+^ f(s,(t)(s, to, X, Mo, d), 0, d{s)) ds for > > fo - f 

x{t — to + 6) forto-t>d>to-t-r 

implies that \\(l)(t,to,x,UQ,d) — x\\r < (t — /o)(l + ^)i^^T^ro<s<ry(s)a{ii(s)a x 
(Ikllr)), where y £ K~^ and a e Koc are the functions involved in Hypothesis (S2), 
and /Li e K'^ and a e Koo are the functions involved in (3.42). This observation, 
combined with Hypothesis (S5), implies that Hypothesis (REG3) holds as well. 
Now, we are in a position to state the following: 

Theorem 3.6 Consider system (1.10) under Hypotheses (Sl-5). Suppose that 
(1.10) is RGAOS. Then, there exist mappings V : S)t+ x C°([-r,0]; *){") -^ Dt+, 
which is almost Lipschitz on bounded sets, /S e A""*", and ai , 02 € K^o such that the 
following inequalities hold for it, x, d) e ?i\'^ x C^{[—r, 0]; ?i\") x D: 

aY{\H{t,x)\\y)<V{t,x)<a2{P{t)\\x\l) (3.59) 

y°(f , x; fit, X, 0, d)) < -V{t, x) (3.60) 

where V°(t,x; f(t,x,0,d)) := limsup;,^o+ ^(^+^-^"(-^'^(;;-'^-°-^»)-'^<''-'-) , and 
Ehix; v) is defined in (2.136) for all v e 9i". Moreover, if (I.IO) is URGAOS, then 
Pit) = 1. Finally, ifil.lO) is T-periodic, then V : 9i+ x C^i[-r, 0]; 9i") -^ 9t+ w 
T-periodic, and if, additionally, (1.10) is autonomous, then V : St"*" x C ([— r, 0]; 
or) ^ 9J+ is independent oft e S){+. 

Proof By Theorem 3.4 there exist mappings V : !W+ x C°([-r,0]; iW") ^ 9i+, 
which is almost Lipschitz on bounded sets, /J e K~^, and ai, (32 e ^00 such that for 
all it, X, d) e S)t+ X C°([-r, 0]; Sli") x M^ and r>t, (3.59) holds and the following 
inequality holds: 

V{r,(t>ir,t,x,UQ,d)) <exp(-(r -t))V(t,x) (3.61) 

The reader should notice that the continuity of V : iH+ x C°([-r, 0]; di") -^ 9t+ 
results from the denseness of the set Ua>o ^'^ i'^ C°([— r, 0]; Dt"). The conclusion 
of the theorem is a direct consequence of the following fact: 

Fact lim;,^o+ '^<'+''-''''"0'd)-Ek(.'^'f(''^'0,d('))) ^ q^^^ ^^^^^ continuous deMo- 

Indeed, by letting dit) = d e D it follows from the above fact and (3.61) that 
(3.60) holds for all (t, x, d) e m+ x C°([-/-, 0]; SH") x D. 

The above fact is a direct consequence of Hypothesis (S3). It is clear that for 
every continuous d e Mo, the composite map fir,x,0,dir)) is continuous on 
im+\A) X C°i[-r,0]; iH"). Applying repeatedly Theorem 2.1 (p. 43) in [9] on 
each one of the intervals contained in [t, +oo)\A, we conclude that the solution 
Tr(T)x — (j)ir,t,x,UQ,d) of (1.10) satisfies kit) — fix,Trir)x,0,dix)) for all 
r e [f , +oo)\A. Since the composite map r — >• /(r, x, 0, dix)) is right-continuous 
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on i)}"*", by virtue of the mean value theorem, it follows that lim;,^o+ "* /; ^ — 
/(f , X, 0, ^(0) for all T e [/, +00). 

The proof is complete. D 



3.4.3 Discrete-Time Systems 

We consider discrete-time systems of the form (1.110) under Hypotheses (Ll-3). 
Particularly, we will further assume that (1.110) is RGAOS and that the following 
additional hypothesis holds. 

(L4) For all bounded sets S C X, I C tt and for every e > 0, there exists S > 
such that sup{||/(f, d, x, 0) — /(?, d, xq, 0)||;f ; d e D} < s for all t e I and 
x,xo e S with \\x — xo\\x < S. 

The following fact is an immediate consequence of Hypothesis (L4) for sys- 
tem (1.110). 

Fact System (1.110) satisfies the property of continuous dependence with respect 
to the initial conditions, i.e., for every pair of bounded sets I C Sit"*", S <Z X and for 
every e > 0, there exists 5 > such that \\(p(t, to, x, uq, d) — (p{t, to, xo, uq, d)\\x < 
e for all t,to & I , d & Mjj, x,xo & S with \\x — xo\\x < S, and t >tQ. 

It follows that Hypothesis (REGl) holds. The following result is a direct conse- 
quence of Theorem 3.4. 

Proposition 3.1 Consider system (1.110) under Hypotheses (Ll^). Suppose that 
(1.110) is RGAOS. Then there exist mappings V : DJ"*" x A" — >• Sit"*", ai, 02 ^ ^00 > '^nd 
P e A""*" such that 

a]_{\H{t,x)\y)<V{t,x)<a2{P{t)\\x\\x) V(r,x) e *){+ x A" (3.62) 

y(r,+i,/(T/,d,x,0)) <exp(-l)y(r,-,jc) 'i(i,x,d) e Z+ x X x D (3.63) 

Moreover, if system (1.110) is URGAOS, then (3.62) holds with P(t) = 1. Further- 
more, for every pair of bounded sets I C St"*", S C X and for every e > 0, there exists 
S > such that \V(t,y) — V(t,x)\ < e for all t e I andx, y e S with \\x — y\\;^; < 8. 
Finally, if, additionally, (1.110) is T -periodic, then V : SH"*" x A" ^ SH"*" is 
T -periodic. 



3.5 Bibliographical and Historical Notes 

1 . There is a large literature on converse Lyapunov theorems for the case of sys- 
tems described by DDEs (see, e.g., [1-4, 7, 8, 12, 15, 18, 21-24, 26-28] and 
references therein). The question of obtaining a smooth Lyapunov function is 
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important, in particular, for design of feedback control systems. However, for 
the purposes of the present work, we do not have to consider smooth Lyapunov 
functions. In fact, we beheve that most of the results obtained by working with 
a smooth Lyapunov function can be also obtained by using a Lipschitz contin- 
uous Lyapunov function. Therefore, Theorem 3.5 is a novel result which does 
not assume the continuity of the right-hand sides of the differential equations or 
Lipschitz continuity with respect to the state variables. 

2. Theorem 3.2 appeared in [14]. As remarked earlier, the use of Theorem 3.2 is 
restricted since no regularity properties are shown for the Lyapunov functional. 

3. Converse Lyapunov theorems for discrete-time systems (with disturbances) have 
appeared in [11, 13, 17]. Again, the question of obtaining a smooth Lyapunov 
function is important. 

4. Theorem 3.6 has appeared in [16] under the same hypotheses. The reader should 
notice that there is a large literature for converse Lyapunov theorems for the case 
of systems described by RFDEs (see [5, 6, 10, 19-21, 29] and references therein). 

5. It should be emphasized that the result of Theorem 3.4 is novel and interest- 
ing since it is a converse Lyapunov theorem for a large class of systems. Many 
infinite-dimensional systems (e.g., described by partial differential equations) 
can be handled by Theorem 3.4: Hypothesis (REG3) is satisfied for appropri- 
ate (dense) subsets of the state space. 
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Chapter 4 

External Stability: 

Notions and Characterizations 



4.1 Introduction 

This chapter is devoted to the analysis of external global stability notions used in 
mathematical control and system theories. The presented stability notions are de- 
veloped in the system- theoretic framework described in Chap. 1 so that one can 
obtain a wide perspective of the role of stability in various classes of deterministic 
systems. The results in this chapter are of both theoretic importance and practical 
relevance since almost all engineering and natural systems are subject to external 
input signals, which may take diverse forms as reference signals and actuator and 
sensor disturbances. 

Another feature that distinguishes the "external" stability notions developed in 
this chapter from "internal" stability notions introduced in Chap. 2 is that the no- 
tions are not uniform with respect to the effect of external inputs. Therefore, the 
notions are not direct extensions of the corresponding stability notions for dynam- 
ical systems with no external inputs, often referred to as the disturbance-free case. 
More specifically, the notions presented in this chapter are variations of the no- 
tion of Input-to-State Stability (ISS), introduced by E.D. Sontag in his seminal 
work [22]. The ISS property has been proved to be very useful for the study of 
nonlinear systems, since it captures two main stability notions: Lyapunov stabil- 
ity (describing the behavior of zero-input response with respect to nonzero initial 
conditions) and bounded-input bounded-state stability (describing the behavior of 
zero-state response with respect to nonzero inputs); see [24] for further details. 

A large part of this chapter is also devoted to the presentation of methods of 
proving external stability properties. In this chapter, we focus mainly on Lyapunov 
methods, although transformation methods and analytical solutions can be exploited 
as in Chap. 2. However, Lyapunov methods have been proved to be much more 
useful for the derivation of useful inequalities that show specific external stability 
properties. Small-Gain methods will be the subject of the following chapter 

In what follows, iJ :— {X, y, Mu, Mo, 4>, tt, H) will be a control system with 
the BIC property and for which e A" is a robust equilibrium point from the input 
u e Mu . Moreover, mq £ Mjj will be the identically zero input, i.e., mo(0 = e t/ 
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for all f > 0. For the output map H : d\~^ x X x U ^ y, we assume that either 
H : d\~^ X X X U ^^ y is continuous or that there exists a partition it — {t,}^Q of 
Df + with diameter r > such that H : di~^ x X x U —^ y satisfies Hypothesis (L2) 
in Sect. 1.7 of Chap. 1. 



4.2 Definitions 

To begin with, consider a RGAOS system E. In other words, according to Theo- 
rem 2.1, there exist functions a e KL and /J, /x e K^ such that the following esti- 
mate holds for all (fo, XQ,d) e d\~^ x X x Mo and t >tQ: 

\\H (t , (pit , to, XQ, UQ, d),Q)\\y + iJ,(t)\\(p(t, to,xo, uo,d)\\j^ 
<(T{P(tQ)\\xo\\x,t-tQ) 

As control engineers, a natural question to ask is whether or not this RGAOS prop- 
erty is robust in the face of nonzero external input u e Mu, i.e., u(t) ^ 0. While 
"robustness" is mathematically interpreted as "structural stability," the essence of 
the question is to understand the impact of external inputs on the behavior of sys- 
tem S , or more precisely the output variables of system Z . 

The answer to the above question is critically important for many practical prob- 
lems, but the answer to the question in our context of general complex systems is 
far from obvious. For example, there is this well-known phenomenon of "finite es- 
cape" (i.e., solutions blow up in finite time) when Z is a highly nonlinear system. 
An elementary example of this kind is the scalar system x — —x + x^u with external 
input u. Clearly, the zero-input system x — —x is globally exponentially stable, and 
thus RGAOS. However, for any arbitrarily small constant input u — u* ^^ 0, some 
solutions blow up in finite time. Indeed, for any initial condition x(0) — xq such that 
u*xr) > 1 and for f > 0, the associated solution x(t) — -fj-, — /° , , , — goes to +oo 

Even in the absence of the finite escape phenomenon for every admissible 
external input u e Mu, there is still no straightforward answer to the question 
we ask. This is because, even when the solutions are defined for each posi- 
tive time, it is still possible that certain inputs produce unbounded output re- 
sponses, i.e., limsup,^_,_(^ \\H(t,(p(t,to,xo,u,d),u(t))\\y — +oo. An interesting 
question to ask is how to characterize the class of external inputs that do not 
produce unbounded output responses. An even stronger requirement is the char- 
acterization of the class of inputs for which the output response converges, i.e., 
limr^+oo \\H(t,(p(t,tQ,xo,u,d), u(t))\\y — 0. 

It is reasonable to expect that the magnitude of the external input ||M(f)||^will 
play a significant role. However, it is worth pointing out that the smallness of the 
size of external inputs (except the trivial case where ||M(r)||^ = 0) does not make 
the problem go away, as shown in the above-mentioned scalar example. 

The notion of (Uniform) (Weighted) Input-to-Output Stability property allows us 
to study the effect of the magnitude of the external input to the output response. This 
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is the major reason that this stability notion has proved to be very useful in Math- 
ematical Control Theory. Of course, it should be emphasized that the (Uniform) 
(Weighted) Input-to-Output Stability property has a large number of theoretical and 
practical applications. 

Next, we present the (Uniform) (Weighted) Input-to-Output Stability property. 

Definition 4.1 Suppose that S is RFC from the input u e Mjj. 

• If there exist functions a e KL, p,S e K~^, and y e M such that the following 
estimate holds for all u e Mjj, {to, xq, d) e di~^ x X x Mom and t > to: 

II //(r, 4>(t, tQ,xo, u, d), u{t)j \\y 

<a{P(to)\\xo\\x,t-to)+ sup y{S(r)\\u(r)\\j.) (4.1) 

to<T<t 

then, we say that S satisfies the Weighted Input-to-Output Stability (WIOS) prop- 
erty from the input u e Mjj with gain y e M and weight S e K'^. Moreover, if 
P(t) = 1, then we say that S satisfies the Uniform Weighted Input-to-Output 
Stability (UWIOS) property from the input u e Mu with gain y eM and weight 
&eK+. 

• If there exist functions g e KL, p e K~^, and y e JV such that the following 
estimate holds for all u e Mu, (to, xo,d) e di~^ x X x Md, and t >to: 

II Hyt, (f>(t, to, xo, u, d), M(f)) II -^; 

<a{p{to)\\xo\\x,t-to)+ sup k(||m(t)|L) (4.2) 

to<z<t 

then, we say that E satisfies the Input-to-Output Stability (lOS) property from 
the input u e Mu with gain y e N . Moreover, if P(t) = 1, then we say that E 
satisfies the Uniform Input-to-Output Stability (UIOS) property from the input 
u e Mu with gain y e N . 

• Finally, for the special case of the identity output mapping, i.e., H(t,x, u) :— x, 
the (Uniform) (Weighted) Input-to-Output Stability property from the input u e 
Mu is called (Uniform) (Weighted) Input-to-State Stability ((U)(W)ISS) property 
from the input u e Mu ■ 

Remark 4.1 Using the inequalities maxja, b) <a + b < max{a + p(a), b + p~^(b)} 
(which hold for all p e Koo and a,b >0), it should be clear that the WIOS property 
for E :— (X, y, Mu, Mo, 4>, tc, H) can be defined by using an estimate based on 
"max," 

//(f, (p(t, to, Xo, u, d), u(t)) L^ 

<ma.\\a{p{to)\\xo\\x,t-to), sup y(5(r)||M(r)|L) (4.3) 

' l0<T<t ' 

instead of (4.1). Notice that the functions a and y involved in (4.1) and (4.3) are not 
necessarily the same. Similarly, the lOS property for E :— (X, y, Mu, Mo, 4>, tt, H) 
can be defined by using an estimate of the form: 
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L//(?, (/)(f, tQ, xq, u, d), u{t)\ Ly 
<mzAa{P(to)\\xQ\\x,t-tQ), sup K(||M(r)|L)| (4.4) 

I to<T<t > 

instead of (4.2). 

We call estimate (4.1) "a Sontag-like estimate," because E.D. Sontag invented 
the notion of ISS in [22] for finite-dimensional continuous-time systems, which is 
expressed using an estimate of the form 

\4i{t,tQ,XQ,u,d)\-^<m2iy}a{\\xQ\\x,t -to), sup y(||M(t)||^) 

Moreover, Sontag and Wang formulated lOS in [27, 28] (see also [8]) for 
continuous-time finite-dimensional systems using an estimate of the form (4.1) with 
/^(0 = 5(0 = 1. 

Exactly as in the case of internal stability properties, for external stability notions, 
we have found the following methods of proving the (U)(W)IOS property in the 
literature: 

(1) Analytical Solutions 

For this line of research, basic estimates for the solutions of the system are 
extracted by actually solving the differential (or difference) equations (or in- 
equalities). 

(2) Transformation Methods 

In this case, basic estimates for the solutions of the system are derived by trans- 
forming the system into a different system with special properties. 

(3) The method of Lyapunov functions and functional 

Basic estimates for the solutions are derived by means of a (or many) Lyapunov 
functional(s) and comparison lemmas. 

(4) Small-Gain Methods 

Basic estimates for the solutions of the system are derived by means of small- 
gain arguments. 

(5) Qualitative Methods 

Certain qualitative properties of the solutions guarantee that the (U)(W)IOS 
property holds. Working in this way, usually we cannot have an explicit ex- 
pression for the gain functions or the weight functions. 

All the above methods, with the exception of Small-Gain methods, will be ex- 
plained in the present chapter. The Small-Gain methods will be explained in detail 
in the following chapter. Again it should be emphasized that the methods of proving 
external stability properties can be (and usually are) combined. 

The following lemmas provide s-& characterizations of the WIOS and UWIOS 
properties. 

Lemma 4.1 Suppose that E is RFC from the input u e My . Furthermore, suppose 
that there exist functions V -.^i^ x X xU ^ S){+ with V (t , 0, 0) — Q for all t > 0, 
y e M, and S e K'^ such that the following properties hold: 
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PI. For all s >0 and T >0, it holds that 

sup\v{t,((>(t,to,xo,u,d),u(t)^ — sup )/(5(t)||m(t)||^); 

^ to<T<t 

t > to, \\xq\\x <s,to& [0, T], d e Md, u e Mu \ < +oo. 
P2. For all s > and T >0, there exists a S :— 8(e,T) > such that 

^\xp\v(t,4>{t,tQ,XQ,u,d),u(t)) — sup y((5(r)||M(r)||^); 

t>to, \\xo\\x <S,toG [0,T],de Mo^ue Mf/l <e. 
P3. For all s > 0, T > 0, and R>0, there exists r :— T(e, T, R) >0 such that 
sup\v{t,(p(t,to,XQ,u,d),u(t)^ — sup y(5(r)||M(r)||^); 

^ to<T<t 

t >to + t, IIxoIIa" < R,to^ [0, T],d e Md, u e Mu \ < e. 

Then, there exist functions a e KL and fi € K'^ such that the following estimate 
holds for all u e Mu, (to, xq, d) e di'^ x X x Md, and t > to'- 

V(t, (p{t, to, xo, u, d), u{t)\ 

<(r{fi{to)\\xo\\x,t-to)+ sup y(^(T)||M(T)|L) (4.5) 

to<T<t 

Moreover, if there exists a e Af such that \\H(t, x, u)\\y < a{V{t,x,u)) for all 
{t,x, u) e Ot"*" X X X U , then for every p e Koo, ^ satisfies the WIOS prop- 
erty from the input u e Mu with gain y e A/" and weight S e A""*", where yis) :— 
a{Y{s) + piY{s))). 

Lemma 4.2 Suppose that E is RFC from the input u e Mu ■ Furthermore, suppose 
that there exist functions V '.yi^ x X x U ^ 'iR'^ with V{t, 0, 0) = Q for all t > 0, 
Y e A/", and S e K'^ such that the following properties hold: 

PI. For every s >0, it holds that 

^\xp\v(t,4>{t,to,xo,u,d),u{t)) — sup y(5(r)||M(r)||^); 

t > to, \\xo\\x <s,to>Q,de Md, u e Mu \ < +oo. 
P2. For every e > 0, there exists 8 :— 8{e) > such that 

^\xp\v(t,4>{t,to,xo,u,d),u(t)) — sup }/(5(r)||M(r)||^); 

' to<T<t 

t > to, \\xo\\x <S,to>0,de Md, u e Mu \ < e. 
P3. For all s > and R >0, there exists x :— r(s, R) >0 such that 

^\xp\v(t,4>{t,to,xo,u,d),u(t)) — sup y(5(r)||M(r)||^); 

t>to + t, \\xo\\x <R,to>0,de Md,u e Mu \ < s. 
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Then, there exists a function a e KL such that estimate (4.5) holds for all u e Mj/, 
(to, XQ, d) e SM"*" X A" X Md, and f > ?o with P(t) = 1. Moreover, if there exists 
a e M such that \\H{t,x,u)\\y <a{y {t,x, u)) for all {t,x,u) e Di"*" x <Y x [/, J/zew 
for every p e A'oc, X" satisfies the UWIOS property from the input u e Mj/ wif/i gain 
y e M and weight S e A'+, where y(s) -.— aiyis) + p(y(s))). 

Remark 4.2 Notice that Lemmas 4.1 and 4.2 can be very useful for the demonstra- 
tion of the (U)WIOS property, because in practice we show Properties (Pl-3) for 
some Lyapunov function V and not necessarily for the norm of the output map. 
Moreover, notice that V is not required to be continuous. If V : S)i+ x A" x C/ — >■ Dt"*" 
is a continuous functional that maps bounded sets of Sit"*" x X x U into bounded 
sets of iH"*", then Lemmas 4.1 and 4.2 guarantee that E satisfies the WIOS and the 
UWIOS properties with V as the output, respectively, from the input u e Mu with 
gain y eJV and weight S e K~^. 

Proof of Lemma 4.1 Let T, h>0,s>0, and define 

a(T,s):—sup\v[t,(t>(t,to,xo,u,d),u{t))— sup y(5(r)||M(T)||^); 

' to<T<t 

\\xo\\x <s,t>toe [0, T], d e Md, ue Mu\ (4.6) 

M(h, T,s) :— sup! V(to + h,(p(to + h,to,XQ,u,d),u(t)) 

- sup y(5(T)||M(T)||^); 
to<i:<to+h 

\\xq\\x <s,toe[0,T],deMD,u e Mu] (4.7) 

First, notice that, by virtue of Property PI, it holds that a(T,s) < +oo for all T > 
and s >Q. Moreover, notice that since e ^Y is a robust equilibrium point from the 
input u eMu and V(t, 0, 0) = for all r > 0, we have a{T, s)>0 for all T >0, 
s > 0. Furthermore, notice that M is well defined, since by definitions (4.6), (4.7) 
the following inequality is satisfied for all T,h >Q and s >0: 

0<M{h,T,s)<a(T,s) (4.8) 

Clearly, definition (4.6) implies that, for each fixed s >Q, a(-,s) is nondecreasing 
and, for each fixed T >0, a(T, ■) is nondecreasing. Furthermore, Property P2 as- 
serts that for every T >0, lim^^o+ '^(T, s) — 0. Hence, the inequality a(T, 0) > 
for all r > 0, in conjunction with limj^o+ o{T, s) = and the fact that a(T, ■) is 
nondecreasing, implies a(-,0) = 0. It turns out from Lemma 2.3 that there exist 
functions f e K^o and q e K~^ such that 

a(T,s)<^{q{T)s) V(r,.)e(i)t+)' (4.9) 

Without loss of generality, we may assume that q e K^ is nondecreasing. More- 
over, Property P3 guarantees that for all £ > 0, T > 0, and R >0, there exists 
r = r(e,r,/?)>0 such that 

M(h,T,s)<s foraLllh>riE,T,R)andO<s<R (4.10) 
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Let 

g(s):^^ + s^ (4.11) 

and let /? be a nondecreasing function of class K^ with p{0) — 1 and 

lim pit) ^+oo (4.12) 

Define 

M(h,T,s) 



/x(/z) :— sup 



;r>0,j>0 (4.13) 



[p{T)giUq(T)s)y 

Obviously, by virtue of (4.8), (4.9), and (4.11), the function fj. : 9{+ -^ S)t+ is well 
defined and satisfies /Lt(-) < 1. We show that lim/,^+oo m(^) — 0; equivalently, we 
establish that for any given e > 0, there exists 8 = 8(s) >0 such that 

ix{h)<e for h> Sis) (4.14) 

Notice first that, for any given e > 0, there exist constants a := fl(e) and b := bis) 
with < a < b such that 

x^ia,b) ^ ^"^ <£ (4.15) 

We next recall (4.12), which asserts that, for the above e for which (4.15) holds, 
there exists c :— c(e) > such that piT)> ^ for all 7 > c. By virtue of (4.8), (4.9), 
(4.11), and (4.15), this yields 

Mih,T,s) , , 

^-^^^ <e V/i>0, whenr>corH^(r)i') ^(fl,Z7) (4.16) 

piT)gii,iqiT)s)) 

Hence, in order to establish (4.14), it remains to consider the case 

a<^{qiT)s)<b and 0<r<c (4.17) 

Since, for each fixed ih, s) e (i)i''~)~, the mappings M(/z, ■, s), Mih, s, ■), qi-), and 
pi-) are, nondecreasing, we have 



Mih,T,s) M{h,c,^-!^) 



(4.18) 



piT)gi^iqiT)s)) - gia) 

where (4.17) was used. By using (4.10) and (4.18) with 

s :— sgia) T:—c R .— 

q(0) 

it follows that 

M(h,c,^--^)<sgia) for h >8is):^r( sgia), c,^--^) (4.19) 

By taking into account (4.16), (4.17), (4.18), (4.19) and definition (4.13) of /Lt(-) it 
follows that (4.14) holds with 8 — 8is) as selected in (4.19). Since e > is arbi- 
trary, we conclude that lim/,^-|_oo m(^) — 0- Consequently, there exists a continuous 
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Strictly decreasing function /2 : ^l'^ -^ (0, +oo) such that il(h) > fiih) for all /; > 
and lim/,^_|_oo A(^) — 0- Thus, by recalling definition (4.13), we obtain 

M{h,T,s)<il(h)e(T,s) WiT,s)e{m+f,Wh>0 (4.20) 

where 0(r,i) :— p(T)g(i;{q(T)s)).C\ectrly,9 satisfies all hypotheses of Lemma 2.3, 
and therefore there exist ^2 e Kqc and P e K~^ such that 

0(r,^)<r2(/^(r)^) V(r,^)eOl{+)' (4.21) 

Thus, definition (4.7) implies that the following estimate holds for all u e My, 
(to, xo, d) e ;H+ X A" X Mq, and t > to: 

V(t, (pit, to,xo, u,d), u(t)) 

</i(f-fo)ft(yS(fo)lkollA')+ sup y(^(T)||M(T)|L) (4.22) 

to<T<t 

Estimate (4.22) implies (4.5) with cr(.j, t) := jl{t)t;2{s). D 

Proof of Lemma 4.2 As in the proof of Lemma 4. 1 , let /; > 0, i' > 0, and define 
a{s):—?,\yp\v(t,(l){t,to,xo,u,d),u{t))— sup y(5(r)||M(r)|L ,); 

' to<T<t 

\\xo\\x <s,t>to>0,de Md, ueMu\ (4.23) 

M{h,s) :— sup! V(to + h, 4>(to + h, to,xo, u, d), u{t)) 

- sup y(3(r)||M(r)||^); 
to<T<tQ+h 

\\xo\\x <s,to>0,d e Md,u e Mu\ (4.24) 

First notice that by Property PI it holds that a{s) < +00 for all s >0. Moreover, 
notice that since e A" is a robust equilibrium point from the input u e Mu and 
V(t,0,Q) — for all f > 0, we have a{s) > for all s > 0. Furthermore, notice 
that M is well defined, since by definitions (4.23), (4.24) the following inequality is 
satisfied for all /i > and .y > 0: 

0<M(h,s)<ais) (4.25) 

Clearly, (4.23) implies that «(■) is nondecreasing. Furthermore, Property P2 as- 
serts that limj^o+ '^(■5) — 0- Hence, the inequality a(0) > 0, in conjunction with 
lim5^o+ 'J('^) — and the fact that a(-) is nondecreasing, implies a(0) — 0. It 
turns out that a can be bounded from above by the Kqc function a defined by 
a(s) :— s + J jj a(w) dw for i' > and fl(0) — 0. Define 



f^(h) :— sup 



M(h,s) 

;^>0 (4.26) 

giais))' ' 



where g is defined by (4.11). Working exactly as in the proof of Lemma 4.1, 
we can show that the function /j. : Dt"*" -^ !){+ is well defined and satisfies 
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/i(-) < 1 and lim/,^_|_oo fJ-W — 0. Consequently, there exists a continuous strictly 
decreasing function /2 : di~^ —>■ (0, +cxd) such that il{h) > fj,{h) for all h >0 and 
lim/,^-i_oo A(^) — 0- Thus, by recalling definition (4.26) we obtain 

M(h,s)<fiih)g{a(s)) V/i,5>0 (4.27) 

Hence definition (4.24) implies that the following estimate holds for all u e Mu, 

(to, XQ, d) edl'^ X X X Md, and t > to: 

V[t, (pit, to, xo, u, d), m(?)) 

<fl(t-to)g{d{\\xo\\x))+ sup y(5(r)||M(r)|L) (4.28) 

fo<r</ 

Estimate (4.28) implies (4.5) with P(t) = 1 and a(s, t) := iJi{t)g(d(s)). D 

Next, some useful observations for T-periodic control systems are provided. It 
turns out that periodicity guarantees uniformity with respect to the initial time in- 
stants. 

Lemma 4.3 Suppose that E :— {X, y, Mu, Md, (j),Tt, H) is T-periodic. If E satis- 
fies the WIOS property from the input u e Mjj , then E satisfies the UWIOS property 
from the input u e My . 

Lemma 4.4 Suppose that E :— {X , y, Mjj , MD,(t>, Jt, H) is T-periodic. If E sat- 
isfies the lOS property from the input u e Mu, then E satisfies the UIOS property 
from the input u e Mu ■ 

Proof of Lemmas 4.3 and 4.4 The proof is based on the following observation: 
if E :— (X, y, Mu, Md,(P, tt, H) is T-periodic, then for all (to, xo, u,d) e M+ x 
X X Mu X Md, we have 0(r, to,xo, u, d) — (f>(t — kT, to — kT ,xo, Pjiju, Ptrd) 
and H(t, (pit, fo, jcq, m, d), u(t)) — H(t — kT, (pit — kT, to — kT,xo, PkTU, Pkrd), 
(PkTu)(t — kT)), with k :— [to/T] denoting the integer part of to/T and the inputs 
PkTU e Mu and P^rd e Md as defined in Definition 1.2. 

Since E :— (X, y, Mu, Md, </>, ^'r, H) satisfies the WIOS property from the in- 
put u e Mu, there exist functions a e KL, fi,S e K^ , and y e J\f such that (4.1) 
holds for all (to,xo,u,d) e di~^ x X x Mu x Md and t > to. Consequently, it fol- 
lows that the following estimate holds for all (to, xo, u,d) e di~^ x X x Mu x Md 
and t > to: 

\\H{t,(pit, to, xo, u, d), u{t)) \y 

<a[^{to-kT)\\xo\\x,t-to)+ sup Y{^{'^)\{PkTu){x)\y) 

Telto-kT,t-kT] 

Setting X —s — kT and since < fo — [ ^ ]7^ < 7^ for all fo > 0, we obtain 

\H{t,(p{t,to,xo,u,d), u(t)) \\y 

<&{\\xo\\x,t-to)+ sup y{S(s-kT)\\(PkTu)(s-kT)\\^) (4.29) 
seltoJ] 
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where ais, t) :— a(rs, t) and r :— max{p{t); < t < T). Estimate (4.29) and the 
identity (PiiTu)(s — kT) — u(s) for all .s > implies that the following estimate 
holds for all (to, xq, u, d) edl'^ x X x Ma x Mb and t > Iq: 

\\H{t, (f){t, tQ,XQ, u, d), u(t)) \\y 

<5{\\xo\\x,t-to)+ sup y{S(s)\\u{s)\\^) (4.30) 

seltoj] 

where S(t) :— max{^(.j); s e [0, ?]}. 

When S :— {X, y, Mu , Mb, </>, n, H) satisfies the lOS property from the input 
u e Mu, all arguments above may be repeated with S(t) = 1. Thus we conclude that 
(4.30) holds for all (to, xq, m, d) e ;)i+ x A" x Mu x Md and t > to with S(t) = 1. 
The proof is complete. D 

Finally, we end this section by giving a simple example to show how analytical 
expressions for the solutions can be exploited for the lOS (or ISS) property. 

Example 4.2.1 Consider the scalar nonlinear system 

k^-xP(x) + u xe9t, MGDt (4.31) 

where /J : J){ — )► 9i is a locally Lipschitz mapping that satisfies 

inf;6(x)>0 (4.32) 

Although analytical expressions for the solution of (4.31) are not (in general) avail- 
able, we know that the solution must satisfy the following integral equation (varia- 
tions of constants) for all t>to for which the solution exists: 

x(t) = x(to)exp(- fi(x(r))dr\+ u(r)sxp(- p{x(s))ds\dr (4.33) 

Define L :— infxem Pix). Using (4.33) and (4.32), we obtain successively: 

|-^(0| < |-^(fo)| expl — / p{x(r))dx\+ j |M(r)|expl— / fi(x(s))ds\dx 

< |x(ro)| exp(— L(f — fo)) + sup |m(t)| / expl — / li[x(s))ds\dr 

to<T<t Jto \ Jt ) 

< |x(ro)| exp(— L(f — fo)) + sup |m(t)| / exp(— L(f — r))(ir 



|x(ro)| exp(— L(f — fo)) + sup \u(x) 

tQ<T<t 

1 



to<Z<t Jto 

l-exp(-L(r-fo)) 



\x(to)\s\p[-L(t - to)) + — sup \u 

E to<T<t 



(r) 



Consequently, it follows that system (4.31) satisfies the UISS property with gain 
function y(s) :— L~^s. 
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4.3 Consequences of the WIOS Property 

The consequences of the WIOS property are numerous and various. In this section 
we focus on certain consequences which will be used in the following sections. 
More specifically, for a control system U :— {X, y, Mu, Mu, 4>, yt, H) which sat- 
isfies the WIOS property, we will show that: 

1 . E satisfies the 0-GAOS property, 

2. S satisfies the Bounded-Weighted-Input-Bounded-Output (BWIBO) property 
and the Converging- Weighted-Input-Converging-Output (CWICO) property, 

3. S satisfies the RFC property from the input u e Mu , 

4. there is a class of static maps for which the feedback interconnection with E 
produces a RGAOS system. 

(a) The 0-GAOS property. 

It is clear from Definition 4.1 that if S :— {X, y. My, Mo, 0, jr, H) satisfies the 
WIOS property, then the system X" :— (X, y, M'jj, MD,(p,Jt, H) with M^ = {mq} 
is RGAOS. Notice that X" := {X,y,My,MD,(t),n,H) is the original system 
S :— {X, y, Mu, Mu, 4),TT, H) for which the only allowable input is the zero in- 
put MO- Moreover, if X := {X, y, Mu, Md,(P, Jt, H) satisfies the UWIOS property, 
then the system E' := {X, y, M[j, Md, </>, n, H) with M[j = {uq} is URGAOS. 
However, the following example shows that there are systems which satisfy the 0- 
GAOS property and do not satisfy the WIOS property. 

Example 4.3.1 Consider the following scalar system: 

X — —X + X u Y=x 

xedi,uedi (4.34) 

It is clear that the 0-GAS property holds for system (4.34), since for m = 0, we 
have X = — x; the fact that x — —x is URGAS can be shown by using the analytical 
expression of the solution. On the other hand, the constant input m = 1 gives the 
scalar system x — ~x + x^ which is not RFC; indeed, using the analytical expression 
for the solution of i = —x + x^, it can be shown that for initial conditions greater 
than 1, the solution cannot be defined for all times. It should be noticed that local 
asymptotic stability for autonomous systems described by ODEs does imply a local 
version of the Input-to-State Stability property (see [17], pp. 217-219). 

(b) Bounded- Weighted-Input-Bounded-Output (BWIBO) and Converging- Weight- 
ed-Input-Converging-Output (CWICO) Properties. 

The BWIBO and CWICO properties are direct consequences of the following 
proposition. 

Proposition 4.1 Consider a system E :— {X ,y , Mu, Mo, </>, H) and suppose that 
E satisfies the WIOS property from the input u e Mu with gain y e Af and weight 
S e K'^ . Then the output trajectory t — >• H{t,(p{t,tQ,XQ,u,d),u{t)) is bounded 
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for all inputs u e My with sup,>Q5(f)||M(f)||^/ < +00 (Bounded Weighted Input 
Bounded Output property) a«(ilimf^-|-c>o H (t , (p{t , to, xq, u, d) , u{t)) — for all in- 
puts u e Mu with linif^-i-oo i5(?)||M(0lli^ — {Converging Weighted Input Converg- 
ing Output property). 

Proof The fact that the output function t -^ H{t, (j)(t, to, xq, u, d), u(t)) is bounded 
for all inputs u e Mu with sup,>oi5(f)l|M(Ollw < +00 is an immediate consequence 
of estimate (4.1). Next, we show that lim?^+oo H{t, (p(t, to,xo, u,d), u(t)) — for 
all inputs u e Mu with lim,^-|_oo^(?)l|M(Ollw — (Converging Weighted Input 
Converging Output property). Consider arbitrary s > 0, (to, xq, d) e d"*" x <¥ x Mo, 
and input u e Mu with lim,^_|_oo 5(0ll"(0llw — 0. Clearly, there exists T > to such 
that y(S(t)\\u(t)\\u) < j for all t > T. By virtue of the weak semigroup property 
for S and since (T + r, to, xo, u,d) e A^, where r > is the constant involved in 
the weak semigroup property for U, there exists T e 7T(to, xo, u,d) n[T,T -\- r]^^ 
with (/>(r, T, (p(T, to,xo, u, d), u, d) — 4>(t, to,xo, u,d) for all t > T. Inequal- 
ity (4.1), in conjunction with the fact that y(5(f)||M(f)llw) < I for all? > T", implies, 
forallr>f, 

I //(f, (/>(f, to, Xo, u, d), u(t)j \\y 
= //(f, (/)(r, T ,(p(T , to, Xo, u,d], u, d), u(t)) L^ 
<cT{p{f)\\(t>{f,to,xo,u,d)\\^,t-f)+ sup y{S(r)\\u(r)\\j^) 

f<T<t 

<a{p{f)\\(P{f,to,xo,u,d)\\^,t-f)+^- 

The above implies that \\H (t , 4>(t , to, xo, u, d), u(t))\\y < e for sufficiently large 
t >T. Since e > is arbitrary, we conclude that 

lim Il(t,d>(t,to,xo,u,d),u(t)) — 0. D 

Each of the BWIBO and CWICO properties fails to be sufficient for the WIOS 
property to hold. The following example illustrates this point. 

Example 4.3.2 Consider the scalar system described by ODE 

X — —ux Y — X 

xem,ue [0, +00) c at (4.35) 

The reader should notice that for every measurable and locally essentially bounded 
input u : di~^ — >• [0, +00), the solution of (4.35) satisfies \x(t)\ < \x(to)\ for every 
t > to- Therefore, the Bounded-Input-Bounded-State property holds. However, sys- 
tem (4.35) does not satisfy the ISS property because the 0-GAS property does not 
hold. For m = 0, we have i = 0. 

Next, consider the scalar system described by ODE 

X — —X + dux 
xed\,uem,de[-l,l] (4.36) 
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It is clear that the 0-GAS property holds for system (4.36), since for m = 0, we 
have X — —x; the fact that i — —x is URGAS can be shown by using the analyt- 
ical expression of the solution. Moreover, the analytical expression of the solution 
of (4.36) x(t) — x(tQ) exp(— (r — Iq) + j^ d{x)u{x) dx) shows that the Converging- 
Input-Converging-State property holds. 

On the other hand, the constant inputs u = 2, d = \ give the scalar system 
X — X for which the solutions are not bounded (unless x(fo) — 0). Consequently, 
the Bounded-Input-Bounded-State property does not hold for system (4.36), and 
therefore system (4.36) does not satisfy the ISS property. 

However, the reader should notice that the UWISS property holds for sys- 
tem (4.36). Indeed, for every /? > 0, the expression for the solution of (4.36) gives 

|jr(f)| = |x(fo)| expl — (/ — ro) + / d{r)u{x)dx\ 

< |x(fo)| expj — (f — fo) + sup (exp(/7T)|M(r)|) / e.x^{—px)dx\ 

\ to<T<t JtQ J 

< |x(fo)|exp(-(f-ro) + P~' sup (exp(;?r)|M(T)|)) 

^ to<r<t ^ 

< |x(fo)| exp(-(f - to)) + \x(to)\exp{-(t - to)) 

X exp(/7"^ sup {exp(px)\u{x)\)) - 1 
'- ^ ro<r<t ' -I 

Using the inequality ah < ja^ + ^b^,v^& obtain 

1 2 

\x{t)\ < |x(fo)|exp(-(r-fQ)) + -|x(fo)| exp(-2(f - ^o)) 

+ T exp(/7"^ sup (exp(/7r)|M(r)|)) - 1 

ZL \ to<T<t ^ -I 

< \x(to)\exp{-(t - to)) + -\x(to)\ exp(-2(r - fo)) 
+ - sup [exp(/9"'exp(pr)|M(r)|) - l] 

^ tQ<T<t 

The above inequality shows that the UWISS property holds with gain y(s) := 
^[exp(p~^s) — 1]^ and weight 8(t) — exp(pt). 

(c) The RFC property from an input. 

It is clear that the RFC property from the input u e Mu is a necessary condition 
of the WIOS property (a direct consequence of Definition 4. 1 . Here, we consider 
control systems which satisfy the additional hypothesis: 

(G) t/ is a cone, i.e., for all m e t/ and A > 0, it follows that (Xu) e U. Furthermore, 
for all u e Mu and A > 0, it follows that (ku) e Mu, where (ku){t) — ku{t) 
for all t > 0. 
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We next consider a control system Z :— {X, y, My, Md, (p,7T, H) with the BIC 
property and for which e A" is a robust equilibrium point from the input u e 
Mjj. If Hypothesis (G) holds, then we are ready to consider the control system 
E' := (A", Y, Mu', Md',(P', n' , H), where X' = X x dl, U' = {0}, D' ^ D x {u e 
U : \\u\\u < 1}, Mo' — {(d, v) e Mo x My : sup,>o ||i'(?)||i^ < 1}, and the fol- 
lowing equalities hold for all {Iq, xq, zq, d, v) e d{~^ x X x di x Mu x {v e Mu : 
sup,>o \\v(t)\\u < 1} and all t e [to, fmax): 

(l)'{t,to,xo,zo,uo,(d,v)) ■.^{<^{t,to,xo,\zo\v,d),zo)eX X di (4.37) 

7T'(to,xo,zo,uo, (d, v)) ■.— 7T{to,xo, \zo\v,d) (4.38) 

where (|zol'^)(0 — \zo\v(t) for all f > 0. The reader can verify that the above defi- 
nitions guarantee that S' :— {X' , Y, My, Mw, (/>', jr', H) is a control system with 
the BIC property and for which e A" is a robust equilibrium point from the input 
u e My (notice that U' — {0}). Moreover, if E is RFC from the input u e Mu, 
then it follows that E' := (A", Y, My, M^,/, </>', ;r', //) is RFC from the input 
u e Mf//. Consequently, Lemma 2.7 implies that there exist functions i^, fi e K~^ 
and a e KL such that, for every (to, xo, zo, d, v) e Dt"*" x X x''M x Md x {i; e Mu '■ 
supr>o ||v(Ollw < 1} and all t > to, we have 

yLi(r)||(/)'(r, to,xo, zo, mo, (d, v)) \\^, <a{P(to){\\xo\\x + \zo\), t - to) (4.39) 

The following observation is crucial: if E is RFC from the input u e Mu, then 
for all (fo, Xo, d, u) e di~^ x X x Mo x Mu and t > to, there exists v e Mu with 
supj>o ||i'(Ollw — 1 such that (p(t, to,xo, u,d) — (pit, to,xo, \zo\v,d), where zo — 
supr|j<^<y \\u{x) \\k. Definition (4.37) and inequality (4.39) give, for all t > to, 

IJ.it)\\(l)(t,to,xo,u,d)\\.y<a(pito)(\\xo\\x+ sup ||M(r)|L), f - ro) (4.40) 

Using Lemma 3.2, Theorem 3.1, and inequality (4.40), we conclude that for every 
pair of functions q,S e K~^, there exist functions ct e KL, p e Koo, and c e K~^ 
such that, for all t >to. 



c(t)\\<l)(t, to,xo, u, d)\ 



X 



<a{q{to)\\xo\\x,t-to)+ sup /7(6(t)||m(t)|L) (4.41) 

ro<T<f 

On the other hand, if inequality (4.41) holds for all (to, xo, d, u) e !H"'" x X x Mo x 
Mu, then E is RFC from the input u e Mu ■ Consequently, we obtain the following: 

Proposition 4.2 Consider a control system E :— (X, y, Mu, Mo, 4>,tt, H) satis- 
fying Hypothesis (G) with the BIC property and for which & X is a robust equilib- 
rium point from the input u e Mu ■ E is RFC from the input u if and only if for every 
pair of functions q, S e K'^ , there exist functions c e A""*", p e Koo, and a € KL 
such that for every (to, xo, d, u) e Di"*" x X x Mo x Mu, inequality (4.41) holds. 

It is clear that Proposition 4.2 shows that a control system E :— (X, y, Mu, 
Mo, 4>,TT, H) satisfying Hypothesis (G) with the BIC property and for which Q e X 
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is a robust equilibrium point from the input u e My is RFC from the input u if 
and only if there exists c e K'^ such that S :— (X, y, Mu, Mo, 4>, tt, H) satisfies 
the (U)(W)IOS property from the input u e Mu for the output H(t, x) :— c(t)x. 
Moreover, the following corollary holds: 

Corollary 4.1 Consider a control system H :— (X, y, Mu, Md, (/>, it, H) satisfy- 
ing Hypothesis (G) and the (U)WIOS property with weight S e K'^ . Then there ex- 
ists a function fi e K^ such that E with output Y — fJ'{t)\\x\\x + \\H(t,x, u)\\y 
satisfies the (U)WIOS property with same weight S e K'^, i.e., there exist func- 
tions a e KL and y e TV such that the following estimate holds for all u e Mu , 
(to, XQ, d) edl~^ X X X Md, and t > to: 



\H(^t,(p(t, to, xo,u, d), u(t)] \\y -\- ij.(t)\\(p(t, to, xo, u,d)\ 



X 



<a{P{to)\\xo\\x,t-to)+ sup y(3(T)||M(T)|L) (4.42) 

tO<T<t 

where fi € K'^ is the function involved in (4.1). 

(d) A class of static maps for which the feedback interconnection with the system 
produces an RGAOS system. 

Consider a control system E :— {X,y,Mu,MD,4>,^,H) which satisfies the 
(U)WIOS property and the following hypothesis: 

(Gl) There exist functions P, /x > and a e Kqc such that 

IJ'(t)\\x\\x <a{\\H(t,x,u)\\y) + P(t) V(f,x,M) €*){+ X X xU. 

Without loss of generality, we may assume that the gain function y e TV is of 
class Koo- Next, consider an interconnected system comprised of U :— (X, y, Mu , 
Md, (p,7r, H) and a static map H : M"*" x X ^ U that satisfies 



1 



lly-j-y-'mH{t,x,H{t,x))\\y) V{t,x)em+xX (4.43) 



for some constant X e (0, 1). We denote hy U :— {X,y, Mq, Md, <p,Jr, H), where 
U — {0}, the control system which results from the feedback interconnection of 
the system S := (X, y, Mu, Md, 4>, n, H) with the static map H : iU+ x X ^ U. 
Notice that here it is implied that the static map H : d\~^ x X ^ U satisfies (4.43) 
and additional requirements so that the feedback interconnection is well defined (in 
the sense explained in Chap. 1). 

Using (4.1), (4.43), and the fact that u(t) — H{t,x{t)), we get the following 
estimate for all (to, xo, d) e SH"*" x X x Md and t e [to, fmax): 

\y<(^{P(to)\\xo\\x,t-tQ)+k sup ||J'(t)|L (4.44) 

•^ to<T<t -^ 
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where x(t) := 4>if'tQ,XQ,uo,d), Y(t) :— H(t,x(t), H{t,x{t))), and fmax is the 
maximal existence time. Inequality (4.43) implies that the following inequality 
holds for all r e [fo, ?max): 

sup \\Y{r)\\y<- -G{p{to)\\xo\\x,Q) (4.45) 

toSr<t -^ i — A 

The BIC property, in conjunction with (4.45) and Hypothesis (Gl), implies that 
fjnax = +00. Moreover, inequality (4.45) and Hypothesis (Gl) imply that X :— 
{X, y, Mq, Md, 4>,Tt, H) is RFC from the input u e Mq (notice that U = {0}). 
It follows from (4.45) that the following inequality holds for all t >to: 

\\Y{t)\\y<j^a{p{tonxo\\x,0) (4.46) 

Inequality (4.46) shows that S :— (X, y, Mq, Md,(J>, H, H) is Robustly Lagrange 
Output Stable and Robustly Lyapunov Output Stable. Next, we show that I! :— 
{X,y, Mfj, MD,4'iTr, H) satisfies the Robust Output Attractivity Property. Let 
s>0,T,R>0, and define, for /z > 0, 

a(h, T, R) := sup{ || Y(tQ + h)\\y:toe [0, T], \\xq\\x <R,de Md} (4.47) 

Inequality (4.46) implies that a(h,T,R) < j±^cr(raa\Q<tg<T Pito)R,0) for all 
h>0. We define 1{T,R) :— \inisupj^^_^_^a(h,T, R). Clearly, there exists 
r(e, T,R)>0 such that a (/; , T, R) < l(T, 7?) + e for all h>x(e, T, R). By virtue of 
the weak semigroup property, for every (to, xq, d) e d{~^ x X x Md with Iq e [0, T] 
and llxoll A* < R, there exists ^ e Jt(to, xq, d) such that f e [ro + ^(e, T, R), r + 
to + r(s, T, R)}. It follows from (4.44) and the weak semigroup property that the 
following inequality holds for all f > f : 

\\Y{t)\\y<G{p{^)\\x{^)\\^,t-^) + k sup ||y(r)|L (4.48) 

Using Hypothesis (Gl), (4.48), and the fact that a(h,T,R) < l(T, R) + e for 
all h > r(e, T, R), we obtain for every {tQ,XQ,d) e di~^ x X x Mj) with Iq e 
[0, T], \\xo\\x < R, and h>r + r(e, T, R): 

\\Y(to + h)\\y<QiE,T,R,h) with 



Q(s,T,R,h):^a 



max P(^) 

^el0.r+T+z(s,T,R)] fl(^) 



ct( max B{to)R,o])],h-r-r(E,T,R) 

l-X \0<to<T I)) 



+ Xl(T,R) + Xe (4.49) 

It follows from definition (4.47) and inequality (4.49) that a(h,T,R) < 
Q(s,T, R, h) for all h > r + r{s,T,R). Therefore we must have l(T,R) — 
limsupij^_^_^a(h, T, R) < limsup/,^_|_QQ Q(s, T, R,h) — Xl(T, R) + Xe, which 
implies l(T, R) < j^e. This implies that E := (X, y, Mq, Md,^, it, H) satis- 
fies the Robust Output Attractivity Property. Therefore, we have established the 
following: 
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Proposition 4.3 Consider a control system U :— {X, y, Mjj , Mo, 4>, tt, H) sat- 
isfying Hypothesis (Gl) and the WIOS property from the input u e My with 
weight S e A""*" and gain y e Koc- Consider 1! :— (X, y, Mq, Md, <p, it, H), where 
U — {Q}, the control system which results from the feedback interconnection of the 
system U := {X, y, Mjj , Mo, 4>,tt, H) with a static map H : £){"'" x X —^ U that 
satisfies (4.43) for certain constant X e (0, 1). Then S :— (X, y, Mq, Mo, 4>,tt, H) 
is RGAOS. 

Next, assume that /J e K^ is bounded, i.e., the system E :— (X, y, Mjj, Mo, 
(/), TT, H) satisfies the UWIOS property. Without loss of generality we may assume 
that j6(f) = 1- Moreover, assume that the following hypothesis holds: 

(G2) There exists a constant P > and a function a e Koo such that the inequality 
\\x\\x <ai\\H{t,x, u)\\y) + P holdsfor all (t,x,u) em+ x X xU. 

Then, the previous analysis in conjunction with (G2) implies that, for all (to, xo,d) e 
di~^ X X X Mo and t > to, the following inequality holds: 

\\x{t)\\^<a(j^a{\\xo\\x,0)] + P (4.50) 

Inequality (4.46) with j6(r) = 1 shows that S := (X, y,Mfj,Mo,^,Ti, H) is Uni- 
formly Robustly Lagrange Output Stable and Uniformly Robustly Lyapunov Output 
Stable. 

Next, we show that E ■.— {X,y, Mq , Mo ,(j),n,H) satisfies the Uniform Robust 
Output Attractivity Property. Let b >Q, R>Q, and define, for h>0, 

aih, R) := sup{ ||y(ro + h)\y:to>Q, \\xo\\x <R,deMo] (4.51) 

Inequality (4.46) with P(t) = 1 implies that a(h, R) < j^aiR, 0) for all h >0. 
We define l(R) :— limsup;,^_|_(^ a(h, R). Clearly, there exists r{s, R) >Q such that 
ci{h, R) < 1{R) + £ for all h > r(e, R). By virtue of the weak semigroup property, 
for every (tQ, xo, d) e di~^ x X x Mo with ||xo||;t' < R, there exists ^ e it (to, xo, d) 
such that ^ e[to + r{e, R), r + to + r(e, R)]. It follows from (4.44) and the weak 
semigroup property that the following inequality holds for all f > § : 

\\Yit)\\y <a{\\xi^)\\^,t - ^) +X sup ||F(T)|L (4.52) 

Using (4.50), (4.52), and the fact that aih, R) < 1{R) + s for all h > r(e, R), we 
obtain, for every (to, xq, d) e d\~^ x X x Mo with to e [0, T], \\xo\\x < R, and h > 
r + x{E,T,R), 

\\yito + h)\\y<Q(E,R,h), 

Q(s, R, h) -.^aiai adljcollA-, 0)\ + P,h-r- r(e, RU + U{R) + Xs 

^ ^^~^ ' ^ (4.53) 

It follows from (4.51) and (4.53) that a(h, R) < Q(e, R, h) for all /z > r + r(e, R). 
Therefore we must have /(7J) — limsup;,^_|_oofl(/!, R) < limsup/,^.,.,^ Qis, R, h) — 
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kliR) + kE, which implies l(R) < j^s. Thus E := (X, y, Mq, MD,(p,it, H) sat- 
isfies the Uniform Robust Output Attractivity Property. Therefore, we have shown 
the following: 

Proposition 4.4 Consider a control system S :— {X, y, Mjj, Mo, 0, Tt, H) sat- 
isfying Hypothesis (G2) and the UWIOS property from the input u e My with 
weight 8 e K'^ andgain y e A'oc. Consider IJ :— {X, y, Mjj, Md, 4>, tc, H), where 
U — {Q}, the control system which results from the feedback interconnection of the 
system U := {X, y, Mjj , Mo, 4>, ^, H) with a static map H : J){"'" y, X ^>- U that 
satisfies {A A2>) for certain constants e (0, 1). Then IJ :— (X , y, Mr,, Mo, 4>,jt, H) 
is URGAOS. 

Propositions 4.3 and 4.4 are important for two reasons: 

(a) they allow us to obtain Lyapunov characterizations of external stability proper- 
ties, and 

(b) they allow us to prove (U)RGAOS by invoking the (U)WIOS property. 

The following example illustrates how we can use (U)WIOS in order to prove 
RGAOS. 

Example 4.3.3 Consider the scalar system described by (4.36). In Example 4.3.2 
we showed that system (4.36) satisfies the UWISS property with gain y(s) := 
j[exp(p~^s) — 1]^ and weight S(t) — exp(pt) for every p > 0. Next, consider the 
system 

P / \ 

X — —X + d —X sxp(— pt)ln[l + 2\\x\) 

xem,de[-l,l] (4.54) 

where p > and X e (0, 1) are constants. The above system can be considered as 
the feedback interconnection of system (4.36) with the static map 

u^-exp{-pt)ln{l+2X\x\) (4.55) 

Notice that inequality (4.43) holds. Moreover, Hypothesis (G2) holds. Therefore, 
we can conclude that system (4.54) is URGAS. 



4.4 External Stability Properties for Discrete-Time Systems 

In this section we will restrict our attention to discrete-time systems for which the 
output map is independent of the values of the input, i.e., H(t, x, u) — H(t, x). Fur- 
thermore, we consider external stability properties for discrete-time systems (1.1 10) 
under Hypotheses (Ll-3) for which the partition it — {t,}^Q is the set of nonnega- 
tive integers Z"*". This is a simplifying assumption, which allows an easier derivation 



4.4 External Stability Properties for Discrete-Time Systems 161 

of the results of this section. Consequently, a discrete-time system with tc — Z^ will 
be written as follows: 

x(t +1) — f{t, d{t),x{t), u(t)) 

Y{t)^H{t,x{t)) (4.56) 

where (?, x,d,u) e Z+ y. X y. D xU . We denote by x(t) the solution of (4.56) with 
initial condition x(/o) = xq corresponding to inputs {d,u) e Mo x Mu . 

The following proposition provides various characterizations of the WIOS prop- 
erty for time-varying system (4.56), either under Hypotheses (Ll-3) or under the 
pair of Hypothesis (Ll-3) and the following hypothesis: 

(L5) For every pair of bounded sets S (Z X xU , I G Z"*" and for every e > 0, the set 
/(/ X Z) X 5) is bounded, and there exists 5 > such that sup{ \\f(t, d,x,u) — 
f{t, d, y, v)\\pi;; d e D] < £ for all r e 7 and (x, u), {y, v) e S with ||x — 

y\\x+ I|m- v\\u <S- 

Remark about Hypothesis (L5) Hypothesis (L5) is "stronger" than Hypothesis (L4), 
in the sense that the implication (L5) =► (L4) holds. Hypothesis (L5) also implies 
Hypothesis (LI). The proof of the implication (L5) =► (LI) is made by defining the 
following function: 

a(T,s) :— sup{ ||/(r, (i,x, m)||^; t e Z"*", t < T, \\x\\x <s,de D, \\u\\k < s] 

which is well defined for all T,s > 0. Moreover, for all T,s > 0, the functions 
a(-, s) and a{T, ■) are nondecreasing, and since f{t, d,0,Q) — e X for all (r, d) e 
Z+ X D, we also obtain aiT, 0) = for all T>0. Finally, let e > and T > 0. It 
can be shown that Hypothesis (L5) guarantees the existence of S :— S{£,T) > such 
that a(r, S{£, T)) < e, and consequently we have lim^^o+ '^(T, s) — for all T >0. 
It turns out from Lemma 2.3 that there exist functions ^ e Koo and p e K^ such that 
a(T,s) < ^(P(T)s) for all T,s >0. Consequently, we obtain \\f{t,d,x,u)\\x < 
^(/i(Omax{||x||;f , ||m||2^}) for all (t,x,d,u) e Z"*" x X x D x U, which directly 
implies Hypothesis (LI). 

Let X,y he a pair of normed linear spaces. We denote by CU(Z~^ x A; W), 
where A C. X, the set of all continuous mappings H : Z"*" x A —^ W c.y with the 
following property: "for every pair of bounded sets I C Z"*", S c. A and for every 
e > 0, the set H(I x S) is bounded, and there exists ^ > such that \\H{t,x) — 
H{t,xo)\\y < s for all r e 7 and x,xo e S with \\x — xo\\x < S." For example, 
if Hypotheses (Ll^) hold for system (4.56) and system (4.56) is RGAOS, then 
Proposition 3.1 implies that V e CU(Z+ x X; M+). 

Proposition 4.5 Consider system (4.56) under Hypotheses (Ll-3) and (G). Then 
the following statements are equivalent: 

(i) There exist functions a e KL, P,S G A""*", and p € Kqc such that the following 
estimate holds for all u e Mu , (to, xq, d) € Z"*" x A" x Mo, and t >tQ: 
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\\H{t,X(t))\\y 

<miix\cj{p(tQ)\\xQ\\x,t-to), sup CT(p(5(r)||M(r)||^),r-r) . (4.57) 

(ii) System (4.56) satisfies the WIOS property. 

(iii) There exist functions 9 € Koo and p e K'^ such that the following system is 
RGAOS: 

x{t + \) ^ f{t,d{t),x{t), p{t)0{\x{t)\^)d\t)) 

Y(t)^H{t,x(t)) 

x(t) e X, 7(0 e y, {d(t), d'(t)) eDx Bu[0, 1], t e Z+ (4.58) 

where Bu[0, 1] :— {u e U; \\u\\k < 1}. 
(iv) There exist functions V : Z"*" x X ^ Jit"*", ai, aj, aj, e K^o, P,(f>, fi & K^ and 
a constant k e (0, 1) such that, for all (t, x,d,u) e Z"*" x X x D x U, 

ai{\\Hit,x)\\y + Mt)\\x\\x)<Vit,x)<a2{pit)\\x\\x) (4.59) 
V{t+l,f(t,d,x,u))<XV(t,x) + a3{(l)it)\\u\\u). (4.60) 

Moreover, if Hypothesis (L5) holds, then V e CU(Z+ x X; S1t+). 

Proof (i) =^ (ii) By setting y(s) :— a(p(s), 0), the desired (4.1) is a consequence 
of (4.57) and the previous inequality. 

(ii) ^ (iii) By Corollary 4.1, there exist functions a e KL, P,S e K^, and y eN 
such that the following estimate holds for all u e Mu, (fo, -^o, '^) e Di"*" x X x Mo, 
and t >to: 



\Y{t)\\y + fl{t)\\x(t)\ 



X 



<CT(j6(ro)||xo||A',?-?o)+ sup k(5(t)||m(t)|L) (4.61) 

ro<T<r 

By Lemma 3.2 there exists a e K^o such that y(rs) < a(r)a(s) for all r,s>0. Let 
A e (0, 1) and define 

9(s):^a-\s) and p(t) -.^ '-^ (4.62) 

Notice that (4.62) guarantees that /?(0^(lkllA') < J7)K~H''^/^(0lkllA')- Moreover, 
system (4.58) is the interconnection of the static map v(t) — p(t)9(\\x{t)\\x) with 
the dynamic system 

x(t + 1) = f{t, d{t),x(t), v(t)d'(t)) 

Y(t)^(H{t,x(t)),ii(t)x) 

with x(t) e X, Y{t) ey -.^y X X, v{t) e di+, {d{t),d'(t)) eDx Bu[0, 1], 
/ e Z"*". Estimate (4.61) guarantees that the above system satisfies the WIOS prop- 
erty from the input v e Mt)j+ with gain y e Af and weight S e K~^ . Finally, no- 
tice that (4.43) and Hypothesis (Gl) hold for the output Y{t) — {H{t,x{t)), ii{t)x). 
Proposition 4.3 implies that system (4.58) is RGAOS. 
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(iii) =► (iv) Notice that since (4.56) satisfies Hypotheses (Ll-3) (or (Ll-3) and 
(L5)), it follows that system (4.58) satisfies Hypotheses (Ll-3) (or (Ll-4)). Let 
A e (0, 1) and define c :— — ln(A). Theorems 2.1 and 3.1 imply the existence of 
functions ai , 02 of class .^oc and j6, /x of class K~^ such that, for all t > to, 

ai{\\Yit)\\y + ix(t)\\xit)\\^) <exp{-2c{t - to))a2{P(to)\\xQ\\x) (4.63) 

where x(t) denotes the solution of (4.58) with initial condition x(fo) — xq corre- 
sponding to inputs (d, d') e Md x Mbu [o, i] • In case where (4.56) satisfies Hypothe- 
ses (Ll-3), we define 

V(to,xo):^sup{exp{cit-to))ai{\\Y(t)\\y + ii(t)\\x(t)\\^) : 

t>to, (d, d') eMox MbuIOA]} (4.64) 

Definition (4.64), in conjunction with estimate (4.63), guarantees that inequal- 
ity (4.59) holds. Moreover, exploiting the semigroup property, we obtain 

V{t+l,f(t,d,x,u)) <XV(t,x) 

Wit,x,d,u)eZ+ X X X Dx [/ with \\u\\u < p{t)9{\\x\\x) (4.65) 

In case where (4.56) satisfies Hypothesis (L5), Proposition 3.1 guarantees the ex- 
istence of y e CU(Z+ X X; m+) satisfying (4.59) and (4.65). Define, for all 

{t,x,u) eZ^ X X xU, 

i/r(f,jc,M):=sup{y(f + \, f{t,d,x,u))\deD] (4.66) 

Clearly, Hypothesis (LI) and inequality (4.59), in conjunction with Lemma 2.3, 
imply the existence of functions co e Koo and q e K~^ such that \jf{t,x,u) < 
0){q{t)\\x\\x) + a){q{t)\\u\\K). Moreover, Lemma 2.3 guarantees the existence of 
functions (5(3 e Koo and0 e K^ such that &)(^(f)0~'(^^)) + a)(^(f)i') < aT,{(j){t)s) 
for all f , s > 0. Combining the previous inequalities and definition (4.66), we obtain 

sup] y(r-|- 1, f{t,d,x,u));d e D, \\u\\u <s,\\x\\x <0~\ ) 

< ai (0 (t)s) for all f , 5 > (4.67) 

We next establish inequality (4.60), with 03 as previously, by considering the fol- 
lowing two cases: 

• \\u\\u < /'(O^(lkllA'). In this case, inequality (4.60) is a direct consequence 
of (4.65). 

• \\u\\u ^ /'(O^(lkllA'). In this case, inequality (4.60) is a direct consequence 
of (4.67). 

(iv) =► (i) Consider the trajectory x(f) of (4.56) that corresponds to input (d,u) G 
Mo X Mu with initial condition x{tQ) — xq e X and define c :— — log(l) > 0, 
V(t) — V(t,x(t)), and b(t) :— exp(2ct)a3((p(t)\\u(t)\\u) for all t > to- Inequal- 
ity (4.60) imphes that V{t + 1) < exp(-c)y(f) + exp(-2cf)ft(0 for all t > to, 
which, by an induction argument, yields 
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V{t) < exp(-c(f - to))V(to) + ^''['^f ""^ , exp(-c(f - to)) 
' exp(c) — 1 

X sup (exp(2cr)a3((/)(r)||M(r)||^)) 'it>tQ (4.68) 

ro<T</ 

By Lemma 2.3, there exist functions p e Koa and S e K~^ such that 

a2^(^^^l^eWi2ct)a3{cP(t)s)j<p{S(t)s), 

where aj e Koc is the function involved in (4.59). The previous inequality, together 
with (4.59), (4.68), and the definition a{s, t) :— 2flJ"'(2exp(-cf)a2('^)) e KL, im- 
plies (4.57). The proof is complete. D 



The following proposition provides a sharper characterization of the lOS prop- 
erty for the time-varying case (4.56), which holds only for discrete-time systems 
with continuous dynamics. For continuous-time systems, the situation is more in- 
volved since the finite escape time phenomenon can occur. Further research is re- 
quired for the case of discrete-time systems with discontinuous dynamics. 

Proposition 4.6 System (4.56) under Hypotheses (Ll-3), (L5), and (G) satisfies the 
WIOS property if and only if the "unforced" system 

x{t+l)^f(t,d(t),xit),0) 

(4.69) 
Y(t)^H{t,x(t)) 

is RGAOS. 

Proof Clearly, if system (4.56) satisfies the WIOS property, then the "unforced" 
system (4.69) is RGAOS. Therefore it suffices to prove the converse statement. 

Notice that by Hypothesis (L5) the "unforced" system (4.69) satisfies Hypothe- 
sis (L4). Since the "unforced" system (4.69) is RGAOS, it follows by Proposition 3.1 
that there exist functions V e CU(Z~^ x X; ?li~^), ai, aj of class Koo, and p of class 
K'^ and constant c > such that 

ai{\\Hit,x)\\y)<V(t,x)<a2{P(t)\\x\\x) W(t,x)eZ+ x X (4.70) 

V{t + l,fit,d,x,0))<sxp(-c)Vit,x) W(t,x,d)eZ+ xX X D (4.71) 
Define the function 

yir, s) := sup{| V(r + 1, f(t, d, x, u)) - V{t + 1, f(t, d, x, 0))|; 

0<t <r,d e D, \\x\\p^ < r, \\u\\ii < s] (4.72) 

By virtue of the right-hand side of inequality (4.70) and Hypothesis (LI), it follows 
that y{r, s) < -t-oo for all r,s >0. Moreover, definition (4.72) guarantees that for 
all r,s >0, the mappings y(r, ■) and y(-,s) are nondecreasing with y(r, 0) — 0. 
Finally, Hypothesis (L5), in conjunction with the fact that V e CU(Z~^ x X; di~^), 
guarantees that lim^^o+ ¥(''' '^) — for all r > 0. Consequently, Lemma 2.3 guaran- 
tees the existence of functions aj, e Koc and e K~^ such that y(r, s) < a^(<j)(r)s) 
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for all r, .J > 0. It follows by definition (4.72) that the following inequality holds for 
all (t,x,u) eZ+ X X xU: 

supy(f +1, f(t,d,x,u))- supy(f + l,/(f,J,Jc,0)) 
deD ' cleD 

<a3{(pmu\\u)+a3{(P{\\x\\x)\\u\\u) (4.73) 

By Proposition 4.2 there exist functions /Lt e K~^ and a e Koo such that for every 
(^0, .'^o. d, u) e Z"*" X X X M[) x My, the corresponding solution x(r) of (4.56) with 
x(to) — XQ satisfies 

^^^<maxja(||xo||A'), sup fl(||«(r)|U} Vf > ro (4.74) 

f^yt) '^ i:elto,t] ' 

Using (4.71), (4.73), Lemmas 2.3, and 3.2, we obtain functions 05, ae e Kqc and 
q e K'^ such that, for all (f , x,d,u) eZ^ x X x D xU ,A holds that 

sup V(t + 1, f(t,d,x, m)) < exp(— c)y(f, x) + exp(— 2cf)fl5(g(OI|M|lw) 



dsD 



■exp(-2cf)fl6 — 7— )a5(q(t)\\u\\u) (4.75) 



Let (to, XQ, d, u) e Z"*" x X x Mo x Mjj and consider the corresponding solution 
x{t) of (4.56) with jc(ro) = xq. Let V{t) := V{t,x{t)). By virtue of (4.74) and (4.75), 
we obtain 

^('^+ 1) <exp(-c)V(0 + exp(-2cr) sup a5(9(r)||M(r)||2Y) 

Te[fo.f] 

-|-exp(-2cO sup {ai{q{r)\u(r)\u)) 
Te[ro,r] 

1 2 

+ Texp(-2cr) sup {a6{a{\u{x)\u))) 

1 2 

+ ^e^^Vi-'^ct){ab{a{\\xo\\x))) 



y(f + 1) <exp(-c)V(r) + exp(-2cO sup pi{r{x)\u{x)\u) 

+ exp(-2cf)p2(||xo||A-) (4.76) 

where pi(.s) ■.^aiis) + ia5{s))^ +\{a(,{a{s))f, p2is) := \{a(,{a(s)))^,2indr{t) := 
^(0 + 1. Inequality (4.76), in conjunction with (4.70), directly implies, for all t > /q, 

ai{\H{t,x{t))\y) <&x^{-c{t - to))a2{hto)\\xo\\x) 

I \ exp(2c) , II II > 

+ exp(-c(r - fo)) sup — -px\r{x)\u{x)\u) 

re[/o,f] exp(c) - 1 ' 

+ exp(-c(f-fo))^^^^P2(lko||A') (4.77) 

exp(c) — 1 ' 
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Finally, (4.77) implies inequality (4.1) with cr(s,t) :— la^ (2exp(—ct)a2is) + 
2exp(-c0jff^P2(^)), /S(f) := P(t) + 1, S(t) := r(t), and y(^) := 
2j|^pr3j-pi (5). The proof is complete. D 

Example 4.4.1 Consider the following nonlinear, finite-dimensional, discrete-time, 
time-varying system: 

x\(t + 1) — d(t)x\(t) 

X2(t + 1) = 2-'^(f)|xi(f)| 2 + u{t) (4-78) 

F(0 = H(f,x(0):=x2(r) 

where x{t) := (xi (?), X2{t)) e'S(^,teZ+, d(t) e [-2, 2], and u(t) em. 

We next show that system (4.78) satisfies the WIOS property by showing that 
system (4.78) with m = is RGAOS. Indeed, noticing that Hypotheses (Ll-3), (L5), 
and (G) are satisfied for system (4.78), the WIOS property is guaranteed by Propo- 
sition 4.6. 

Consider the trajectory x(t) of (4.78) with m = that corresponds to input d e 
Md with initial condition x(to) — xq e dl^. Since \d{t)\ < 2, it follows from (4.78) 
that, for all t >tQ, 

|xi(f+l)|<2|xi(f)| (4.79) 

By induction and with (4.79), we obtain the following estimate for all t >t(): 

|xi(0|<2'-'o|xi(fo)| (4.80) 

Using (4.78) with u = 0, (4.80) and the fact that \d(t)\ < 2, we obtain, for all t > 
fo+1, 

\x2(t)\ <Mexp(-c(r-fo))|xi(fo)|'''^ 

where c :— ^y^ and M :— 2^2. Consequently, the following inequality holds for 
all t > fo: 

|x2(0| < exp(-c(f - ro))p(|x(fo)|) (4.81) 

where p(s) :— max{s, M^}. It follows from (4.81) that system (4.78) with m = 
is URGAOS. 

It should be noted that although system (4.78) is guaranteed to satisfy the WIOS 
property, we cannot determine the gain function or the weight function. This hap- 
pens because we exploited the qualitative characterization of Proposition 4.6. 

In order to be able to determine the gain and weight functions for the WIOS 
property, one has to use comparison lemmas based on difference inequalities. The 
following lemma illustrates this point. 

Lemma 4.5 Suppose that there exist functions V : Z+ x X ^ Sit"*", W : Z"*" x X x 
U -^ di, P,& e K~^ , y e Af, and a positive definite function p e C (DJ"*"; di~^) such 
that the following implications hold for all {k, x,d, u) e Z"*" x X x D x U: 
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V{k,x)>W(k,x,u) =^ V{k+l,f{k,d,x,u))<V{k,x)-p(V(k,x)) 

(4.82) 

V{k,x)<W{k,x,u) ^ V{k+l, fik,d,x,u)) <a{Sik)\\u\\u) (4.83) 

Then there exists a e KL such that, for all t >tQ, 

V{t,x(t)) <max\a[V{to,x(to)),t -to), max a{a(S{k)\\uik)\\jj),t - k) 

Moreover, if there exist functions P e K^ and a\,a2 & Kqo such that 

ai{\\H(t,x)\\y)<V(t,x)<a2{P(t)\\x\\x) W(t,x)eZ+ xX (4.84) 

then, system (4.56) under Hypotheses (Ll-3) satisfies the WIOS property with gain 
y(s) := flj~ ia(s)) and weight 8 e K~^ . Finally, if Pit) = 1, then system (4.56) under 
Hypotheses (Ll-3) satisfies the UWIOS property with gain y(s) :— aj" (a(s)) and 
weight S e K+. 

Proof Define, for all (k, s) e Z+ x M+ and te[k,k+ 1), 

g(s):^ max{y-p{y)) (4.85) 

ais,k):^g^''\s):^go---ogis) and a(s,0);=5 (4.86) 

k times 

ais, t) := (t - k)a(s, k+l) + (k+\- t)a(s, k) (4.87) 

Definition (4.85) implies that the function g e J\f satisfies g(s) < s for all i > 0. 
A simple contradiction argument shows that \imk^ +oo g^'^Hs) — for all s >0. 
Therefore, definitions (4.86) and (4.87) imply that a e KL. 

Consider the trajectory x{t) of (4.56) that corresponds to input {d, u) e M^ x 
Mil with initial condition x(to) — xq e X. First suppose that t > to+ 1. We distin- 
guish the following cases: 

Case 1: Assume that V{k, x{k)) > W{k, x(k), u{k)) fox &\\k — tQ, . . . ,t — \. Then 
using implication (4.82) and definitions (4.85), (4.86), we obtain, by using induc- 
tion, 

V{t,xit)) < a{V{to, x(to)), t-to). (4.88) 

Case 2: Assume that there exists k e {to, . . . ,t — 1} with V(k, x(k)) < W(k, x{k), 
uik)). Let / := max{jfe e {to, . . . ,t - I] : V{k, x(k)) < W(k, x(k), u(k))}. If / < 
t - 1, then it holds that V(k, x{k)) > W(k, x(k), u{k)) for alU = / + 1, . . . , f - 1. 
Therefore, by virtue of (4.88) we have 

V{t,x{t)) <a{V{l + \,x(l + \)),t-l-l). (4.89) 

On the other hand, (4.83) implies that V{1 + \,x{l + 1)) < a{&{l)\\u{l)\\ii)- 
Therefore, from (4.89) we obtain 

V{t,xit))<d{a[8Q.)\u{l)\j^),t-l-\) (4.90) 
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Notice that inequality (4.90) holds for the case I — t — 1. Combining (4.89) 
and (4.90), we obtain that, for all r > ro + 1, 

V{t,x(t)) <max\a[v{to,xito)),t -to), max a{a{S(k)\\uik)\\jj),t - k) 

where cr(.?,f) :— s for all (s , t) e 9{+ x [0, 1) and cr(.?,f) :— a (s,t- I) for all (s,t) e 
di~^ X [1, +oo). Finally, notice that the previous estimate holds for the case t — to as 
well. 

The rest of the proof is a direct consequence of the above estimate. D 

Lemma 4.6 Suppose that there exist functions V : Z+ x A" — >• iH"*", W : Z"*" x 
X — >• iH"*", yS, 5 e A""*", and y E J\f and a constant 1 e (0, 1) such that the solution 
x(t) of (4.56) that corresponds to input (d, u) e Mo x My with initial condition 
x(to) — xo & X satisfies the following inequality for all t > to'- 

V{t + l,x(t + l))< XV {t, x(t)) + X'-'°W{to, xo) +a{S(t) \\u(t) ||^) (4.91) 

Moreover, suppose that there exist functions /S e A""*" and fli, 02 e A'cxd such that 

ai(\\H(t,x)\\y)<Vit,x) ] 

\ W(t,x)eZ+ xX (4.92) 
V(t,x) + k-^W(t, x) < a2iPmx\\x) ] 

Then system (4.56) under Hypotheses (Ll-3) satisfies the WIOS property with 
gain y{s) :— a^ ij:z)^a(s)) and weight fi,S e K~^ . Finally, if Pit) = 1, then sys- 
tem (4.56) under Hypotheses (Ll-3) satisfies the UWIOS property with gain y (s) :— 
aj~ (a(s)) and weight P, S E K~^ . 

Proof Consider the trajectory x(f) of (4.56) that corresponds to input (d,u) e Md x 
Mjj with initial condition x{to) — xo & X. Using induction and (4.91), we obtain, 
for all nonnegative integers A; > 0, 



V{to + k,x(to + k)) 



k-l 



<x''V{to,x(to)) + J2^''~^~'{^'W('o,xo)+a{S(to + i)\\u(to + i)\\^^)) (4.93) 

(=0 

Using (4.93), we obtain, for all nonnegative integers A; > 0, 
V{to + k,x(to + k)) 

<x''{V{to,x(to))+X-^W{to,xo)) + - max a{S(i)\\u(i)\\j.) (4.94) 

The rest of the proof is a direct consequence of the above estimate. D 

Example 4.4.2 Again consider the nonlinear finite-dimensional discrete-time time- 
varying system (4.78). In order to determine the gain and weight functions, we have 
to consider the continuous function V{t,x) :— exp(— f)|xi| -|- \x2\, which clearly 
satisfies the following inequality for all (t, x, d, u) e Z"*" x Df^ x [—2, 2] x ?i\: 
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V{t+ l,dxi,2~'d\xi\^ +u) 

<exp(-f - l)|fif||xi| +2-Vlkil^ + |m| 
<2e-'exp(-0ki| + 2-'+Vi|5 + |M| (4.95) 

Let x(t) denote the solution of (4.78) initiated from jcq e i)i^ at time to e Z"*" and cor- 
responding to (d, u) e M[_2,2] X Mt)!. Notice that inequality (4.95), in conjunction 
with (4.80), gives 

y(f+l)<2e-'y(0 + 2-^2|xo|2 + |M(0| Vf>fo (4.96) 

Clearly, inequality (4.91) holds for ^^ = f , W{t, x) := 2\x\^/^, a{s) := s, and 8{t) = 
1. Moreover, inequality (4.92) holds with ai{s) :— s, /J(f) = 1, and a2(s) :— 2s + 
^s^l'^. We conclude from Lemma 4.6 that system (4.78) satisfies the UIOS property 
with gain y (5):= -^s. 

Finally, we end this section by providing characterizations of the UIOS property 
for system (4.56). 

Proposition 4.7 Consider system (4.56) under Hypotheses (Ll-3), (L5), (G), 
and (G2). Suppose that (4.56) is T -periodic. Then the following statements are 
equivalent: 

(i) There exist functions a e KL and p eAf such that the following estimate holds 
for all u e Mu, (to, xq, d) e Z"*" x X x Md, and t > t^: 

\H{t,x{t))\y<m&x\a{\\xQ\\x,t-to), sup a{p{\u{x)\^),t - x)\. 

Te[fo,r] ' 

(4.97) 

(ii) System (4.56) satisfies the UIOS property. 
(iii) There exists a function 6 e ^00 such that the following system is URGAOS: 

x(t + 1) = f{t, d(t), x(t),6{\\H{t, X(t)) \\y)d'(t)) 

Y{t) = H{t,x{t)) 

xit) e X, Y(t) e y, {d(t), d'{t)) eDx B(/[0, 1], t e Z+ (4.98) 

where Bu[0, 1] :— {u e U; \\u\\u < !}• 
(iv) There exist functions V G CU{Z~^ x X\ !){"*"), which is T-periodic, and 
ai,a2,a^ e A'oo and a constant k e (0, 1) such that, for all (t,x,d,u) e 
Z+ xXxDxU, 

ai (II Hit, x) \\y) < V(t, x) < a2{\\x\\x) (4.99) 

V{t+l,f(t,d,x,u)) <XV(t,x)+a3{\\u\\u)- (4.100) 

Proof (i) =^ (ii) The desired (4.1) is a consequence of (4.97) with y(s) :— 
a(p(s),0). 
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(ii) ^ (iii) Without loss of generality we may assume that the gain function y 
is of class Koo- Let X e (0, 1) and define 6(s) :— y~^{Xs). System (4.98) is the 
feedback interconnection of the system 

;c(f + 1) = f[t, d(t), x(t), v(t)d'(t)) 
Yit)^H{t,x(t)) 
x(t) e X, Y(t) e y, v(t) e 3{+, {d{t), d'{t)) eDx Bu[0, l]j e Z+ 

with the static map v(t) — 9(\\H(t,x{t))\\y). Clearly, the above system satisfies the 
UIOS property from the input v e M;ij+. Finally, notice that (4.43) and Hypothe- 
sis (G2) hold. Proposition 4.4 impHes that system (4.98) is URGAOS. 

(iii) =► (iv) Since (4.56) satisfies Hypotheses (Ll-3) and (L5), it follows that 
system (4.98) satisfies Hypotheses (Ll^). Proposition 3.1 implies the existence 
of mappings V e CU{Z~^ x X; !]{"'"), which is T-periodic, and 01,02 e Koo and a 
constant A e (0, 1) such that inequality (4.99) holds and 

V{t+l, fit, d, X, u)) < XV(t, x) V(f , x,d,u)eZ'^ X X X DxU 
with||M||i^<6»(||//(f,x)||y) (4.101) 

Since the mappings / : Z"*" xDxXxU^X and H : Z+ x X ^ y are 
T-periodic, from Hypotheses (LI), (L2), (L3), Fact I in Sect. 2.2, and Lemma 2.4, 
there follows the existence of a e Kqc such that 

||/(f,fif,.x,M)||^ + ||//(f,x)||y <a(lkllA') + fl(l|M|lw) 
V(t,x,d,u)eZ'^ X X X DxU (4.102) 

Define, for all i' > 0, 

i/f (5) := sup{y (f + 1, fit, d, x,u))-V{t+l, fit, d, x, 0)); 

deD,t>0,\\u\\u<s, \\Hit,x)\\y<e-\s)} (4.103) 

Clearly, Hypothesis (G2) and inequalities (4.99), (4.102) imply that the mapping 
i/f : di~^ -^ iW"'" is well defined, locally bounded, and nondecreasing. Moreover, 
Hypotheses (L5), (G2) and the fact that V e CC/(Z+ x X; i1t+) guarantees that 
lim5^o+ iris) = i/f(0) = 0. Consequently, Lemma 2.4 implies the existence of 
C13 e Kqc such that iris) < a^is) for all s >0. 

We next establish inequality (4.100), with 03 as previously, by considering the 
following two cases: 

• \\u\\u < ^(Il^(^-^)ll3^)- In this case inequality (4.100) is a direct consequence 
of (4.101). 

• \M\u — ^(Il^(^-^)ll3^)- In this case inequality (4.100) is a direct consequence 
of(4.101) and (4.103). 



(iv) =► (i) Notice that inequalities (4.99), (4.100) guarantee that the assumptions 

^a.iMu), ais) := {±^. 



of Lemma 4.5 are satisfied with Wit,x,u) :— fzja^iWuWu), ais) :— Yzja^is) 



p{s) :— ^-j^s, and i5(r) = 1. The proof is complete. D 
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4.5 Transformations Preserving WIOS 

The method of verifying external stabihty properties using transformations is used 
frequently in Mathematical Control Theory and Stability Theory. Roughly speaking, 
we want to verify the WIOS property for a system S which is the transformation of 
another system U' (in the sense described in Sect. 1.6). Suppose that we can estab- 
lish that S' satisfies the WIOS property (using another method, e.g., by solving the 
differential (or difference) equations (or inequalities)). Then S satisfies the WIOS 
property. 

Proposition 4.8 Consider a control system E := iX,y, Mfj, Md, (j),n,H) which 
satisfies the BIC property and for which & X is a robust equilibrium point 
from the input u e My. Suppose that E satisfies the WIOS property. Let <P : 
Dt"*" X X ^ X be a change of coordinates and q : SH"*" x V —>■ U be a transfor- 
mation of Vonto U, V ^U. Then the system S' :— {X, y, My, Md,(P', tt' , H') 
defined by (1.106), (1.107), (1.108) satisfies the WIOS property. Moreover, if S sat- 
isfies the UWIOS property and there exists a e K^ such that (2.65) holds, then the 
system U' := {X, y. My, Md,(P', tt' , H') defined by (1.106), (1.107), (1.108) sat- 
isfies the UWIOS property. Finally, if S satisfies the lOS property and there exists 
^ e A'oo such that 

\\qi.t,v)\\j^<l;{Mu) V(f , t;) e Sl{+ X y (4.104) 

then, the system E' := {X,y,Mv,MD,(j)',Tt',H') defined by (1.106), (1.107), 
(1 . 108) satisfies the lOS property. 

Proof By Lemma 1.2, X" :— {X, y. My, Md, </>', Jt' , H') is a deterministic con- 
trol system which satisfies the BIC property. Moreover, e A:" is a robust equi- 
librium point from the input v e My for E' . By Lemma 2.8, the system E' :— 
(X, y, Mu, Md, (/>', Jt', H') is RFC from the input v e My . 

Finally, notice that by Definition 4.1, there exist functions a e KL, P,S e K~^, 
and y eN such that estimate (4.1) holds for all {to, xq, d, u) e 9i+ xX x Md x Mu 
and t > tQ. Definitions (1.106) and (1.108), in conjunction with (4.1), imply that the 
following estimate holds for all (to, xo,d) e di'^ x X x Md, v e My and t >to: 

\\H'{t,(t)'{t,to,xo,v,d),vit))\\y 
= \\H{t,(p{t,to,0~^(to,xo), Qv,d),q{t,v(t)))\\y 
<(T{P(to)\\<p-\to,xo)\\^,t-to)+ sup y{S(t)\\q{r,v(r))\L) (4.105) 

to<T<t 



Since : di^ x A" ^ A" is a change of coordinates, it follows from Lemma 3.2 
that there exist a e Koo and p e K'^ such that ll^"^^^)!!^' < /'(^)«(lkllA') for 
all {t,x) e Dt"*" X X. Since q : i)}"*" x V — >■ £/ is a transformation of V onto U, it 
follows from Lemma 2.3 that there exist functions ^ e Koo and /x e K~^ such that 
S{t)\\qit, v)\\u < ^(ii{t)\\v\\u) for all (t, v) e *){+ x V. Consequently, from (4.105) 
we obtain 
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\H'{t,(P'it,tQ,XQ,v,d),v{t))\\y 



<cj{p(to)p(to)a{\\xo\\A:),t-to)+ sup K(<(/i(r)||i.(r)|L)) (4.106) 

/o<T<r 

The above inequality shows that the system S' :— {X, y. My, Mo, 0', it' , H') de- 
fined by (1.106), (1.107), (1.108) satisfies the WIOS property. 

All other cases are treated similarly. The proof is complete. D 

Example 4.5.1 All linear time- varying systems described by ODEs 

k ^ A{t)x + B{t)u jceS1{",MeC/c9r (4.107) 

where the matrices A{t) e di"^" and B(t) e i)i"^'" have continuous components, 
satisfy the UWISS property from the input u e Mu if and only if the system x — 
A{t)x, X e dV\ is URGAS. To see this, notice that if the system i — A(t)x, x e !){", 
is URGAS then by Theorem 3.9, p. 143, in [17] there exist constants M, a > such 
that the fundamental solution matrix of the system satisfies 

|<?(f,ro)| <Mexp(-cr(r-fo)) forallf>ro>0 (4.108) 

The variations of constants formula for the solution of (4.107) implies that 



Jtn 



x{t) = 0{t,to)x{to)+ / 0{t,r)Bir)u(r)dr (4.109) 

Let (5 e ^+ be a function that satisfies \B{t)\ < S{t). Then by combining (4.109) 
with (4.108) we obtain, for the solution of (4.107), 

\xit)\<Mexp{-ait-to))\x(tQ)\+McT~^ sup (5(T)|M(r)|) (4.110) 

ro<r<r 

Consequently, system (4.107) satisfies the UWISS property with gain function 
y(s) :— Ma~^s and weight S e K'^ . 

By Proposition 4.8, it follows that the UWISS property holds for all nonlinear 
systems of the form 

i = /(f,x,M) jfG Sir, Met/ car (4.111) 

which satisfy Hypotheses (HI), (H3), (H4) in Sect. 1.2 and for which there exist a 
continuously differentiable change of coordinates : di~^ x S)i" -^ di" satisfying 

\0{t,x)\<a{\x\) and \0~\t,x)\ <a{\x\) (4.112) 

for all (t,x) e Oi"*" x 9t", for certain a e Koo and a continuous mapping p : M"*" x 
U -)- V with V c di"^ and p(t,0) — Q for all t > 0, for which the following system 
of partial differential equations holds for all (t,x,u) e di~^ x di" x U: 

(t, x) H (t, x)fit, X, u) = A{t)(p{t, x) + B(t)pit, u) (4.1 13) 

dt dx 

where the matrices A{t) e Of{"^" and Bit) e Sli"^'" have continuous components, 
and the system x — A(t)x, x e Dt", is URGAS. 
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4.6 Qualitative Characterizations of WIOS 

Consider a system H :— {X ,y,Mu,MD,(p,Tt,H) with outputs // : S)t+ x 
X ^ y, which is Robustly Forward Complete from the input u e Mjj and satis- 
fies the following hypotheses: 

(CONl) There exists a partition n — {7;}^q of Sit+with finite diameter such that 

1. for each (^o, ^o, «, cf) e S)t+ x A:" x Mu x Md, it holds that n n (fo, +oo) c 
n{tQ,XQ,u,d), where n{tQ,XQ,u,d) is the set involved in Property 4 of Defini- 
tion 1.1 (weak semigroup property), 

2. for each bounded set 5 C A:" and for every {T, R, s) e JH"*" x Sit"*" x (0, -foo), 
there exists S > Q such that sup{\\4>(T,to,x,u,d) — (j)(r,to,xo, 
v,d)\\;^; d e Mo, r e [to,q„(to)]} < s for all to e [0, T] n jt, x,xq e S, and 
u,v e M(Bu[0, R]) n Mu with \\x —xo\\x + sup,p<^<j \\u(r) — fCr)!!^ < S, 

3. for any sequences {di e M]:,}°Zq and {m/ e Mu}°^q, the mappings Pd : di~^ -^ 
D and Pu ■.m+ ^ U with Pd{t) := di{t), Pu{t) := m,(0 for all Ti <t < Ti+u 
i —0, 1,2, . . ., belong to Md and Mfj, respectively. 

(C0N2) Complete Continuity of the Output Map: For every pair of bounded sets 
/ C St"*", S (Z X and for every e > 0, there exists 5 > such that \\H{t,x) — 
H{t, XQ)\\y < e for all f e / and x,xq e S with \\x — xq\\x < S. 

Hypothesis (C0N2) is a standard continuity assumption, which can be verified 
easily for a very wide class of systems. Hypothesis (CONl) is a technical hypothesis 
that guarantees the following two properties: 

(a) the continuity of the transition map with respect to the external input and the 
initial state, 

(b) the set of times that satisfies the semigroup property, i.e., the set 7r(ro, xq, u, d), 
contains all members of the partition n — {7/},^o greater than tQ. Thus the par- 
tition n — {Ti}f^Q can be used in order to discretize time for all initial con- 
ditions and inputs. Notice that this requirement is automatically satisfied if 
7T(tQ, XQ, u,d) — [to, -|-oo) (i.e., the case where the system is RFC from the input 
M e Mu and satisfies the classical semigroup property). 

Let us here remark one case where Hypothesis (CONl) is (generally) not satis- 
fied, the case of control systems with variable sampling partition (1.57). 

For systems satisfying Hypotheses (CONl), (C0N2), the following result pro- 
vides equivalent characterizations for the WIOS property. 

Theorem 4.1 (Necessary and sufficient conditions for the WIOS property) Con- 
sider a system E :— (X ,y , Mu, Md, (j), it, H) which is RFC from the input u e Mu 
and satisfies Hypotheses (CONl), (CON2), (G). Moreover, suppose that E: X is a 
robust equilibrium point from the input u e Mu for E . The following statements are 
equivalent: 

(i) there exist functions a e KL, P, y & A""*", and p e Kqo such that the following 
estimate holds for all u e Mu, (fo> xq, d) e '^X^ x A" x Mo, and t >to: 
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II //(f, (j)(t, to,Xo, u, d), m(0) II a; 

<ma.xla{P(to)\\xo\\x,t -to), sup CT(p(}/(T)||M(r)||^), f - r) . 

(4.114) 

(ii) S satisfies the WIOS property from the input u e Mjj . 
(iii) S satisfies the 0-GAOS property. 

Estimates of the form (4.114) ("fading memory estimates") were first used by 
Praly and Wang [21] for the formulation of exp-ISS and by Griine [3, 4] for the 
formulation of Input-to-State Dynamical Stability (ISDS) with H{t,x) — x and 
P{t) = y{t) = 1, which was proved to be qualitatively equivalent with (4.2) for 
finite-dimensional continuous-time systems. It is clear that Theorem 4. 1 shows that 
for the WIOS property, the "fading memory" estimate (4. 1 14) is qualitatively equiv- 
alent to the "Sontag-lilce" estimate (4.1). 

Proof of Theorem 4.1 Notice that the implications (i) =^ (ii) and (ii) =^ (iii) are 
immediate. Thus we are left with the proof of the implication (iii) =^ (i). 

By virtue of Proposition 4.2 and since (i) Hypothesis (G) holds, i.e., u e My for 
all (m, X) e Mu x Di"'", where u is the input that satisfies u{t) — Xu{t) for all t >0, 
(ii) Z is RFC from the input u e Mjj , and (iii) e A" is a robust equilibrium point 
from the input u e My for S, there exist functions fi e K^ and a e K^o such that 
the following estimate holds for all (to, xo, d, u) e S)}"*" x X x Mu x My: 

\(j>{t,to,xo,u,d)\^< lJi(t)ai\\xo\\x + sup ||m(t)||^) Vf > fo (4.115) 

By virtue of Theorem 2.1 and since 'E :— {X, y. My, Mu, (j),Tt, H) satisfies the 0- 
GAOS property, we guarantee the existence of functions a e KL and /J e K'^ such 
that the following estimate holds for all (fo, xo,d) e Dt"*" x X x Mu and t >to: 

\\H{t,(P{t, to, xo, MO, d), 0) II -y <(j{Pito)\\xQ\\xJ - to) (4.116) 

Let TT — {Ti}°°_Q the partition of iH"*" for which Hypothesis (CONl) is satisfied, and 
let r > be its diameter, i.e., r :— sup{Ti^i — T,; i = 0,1,2, ...} < +oo. 

LetM£/C My be the cone of inputs u e My withsup,>o ||m(OIIw < +oo, which 
is a subset of the normed linear space MU of bounded functions u : iii"*" —>■ U with 
norm ||m||mw := sup,>o ||M(f)||i^. 

The proof is divided into two parts: 

Part 1: We apply an abstract discretization technique, which provides an infinite- 
dimensional discrete-time system satisfying the WIOS property. 

Part 2: The solution of the discrete-time system obtained from the 1st part is related 
to the solution of U, and we show that estimate (4. 1 14) holds for all bounded inputs 
ueMU. 

Since estimate (4.1 14) holds for all bounded inputs u e MU, we conclude that S 
satisfies the WIOS property. 
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Part 1 : Abstract Discretization 

Define the normed linear space FX of bounded functions x : [0, r] ^ X with 
norm ||x||fx := ^up^gm r] \\^((^)\\x- Let CMd and CMf/ denote the set of sequences 
with values in Md and MU, respectively. For (/, x, d, u) e Z"*" x FX x Mn x My, 
where x(0) e X for 6 e [0, r], define 



f(i,d,x,u):^\ ^ ^ (4.117) 

a map, which is well defined and satisfies (see (4.1 15)) 

||/(i, cf, X, m)||pj^ < /i(/)a( II^IIfx + sup ||"('^)||7/) 

V(i,x,£/, M)eZ+ xFXxMz) X Mf/ (4.118) 

where /!(/) :— niax7;</<7;^, /U,(f)- By Hypothesis (CONl) and inequality (4.118) it 
follows that / is completely continuous, i.e., satisfies the following hypothesis: 

(C0N3) For all bounded sets 5 C FX x MU and / C Z+ and for every e > 0, the 
set f{Iy. Md X S) is bounded, and there exists S > such that 

supl /(/, d, X, u) — f(i, d, XQ, Mo) -v.; ^ € Mo} < s 

for all / e /, (x, u) e 5', and (xq, uq) e S with ||x — xqUfx + I|m — mqUmiy < ^• 
Moreover, /(/, d, 0, 0) = for all (/, d) e Z+ x Mo- 

Define the normed linear space FY of bounded functions Y : [0,r] -^ y with 
norm ||y||FY := supg^m ^i ||y(0)||y. Define the output map for (i,x) e Z"*" x FX: 

Hii,x):^H{ma\{0,Ti-r + e},x(e)) ee[0,r] (4.119) 

By virtue of Hypothesis (CON2) and the fact that the continuous map H : di~^ x 
X ^^ y maps bounded sets of SH"*" x X into bounded sets of y, it follows that H is 
completely continuous, i.e., satisfies the following hypothesis: 

(C0N4) For every pair of bounded sets / C Z+, S C FX and for every e > 0, the set 
H(I X S) is bounded, and there exists ^ > such that \\H{i, x) — H{i, xq) II3; < e 
for all i e I and x,xo e S with \\x — xq\\x < S. Moreover, H{i, 0) = for all 

teZ+. 

Next consider the discrete-time system 

Xi+l = f{i,di,Xi,Ui) 

Yi^H(i,Xi) 

(i, Xi, Yi,di,ui) e Z+ X FX X FY X Md X MC/ (4.120) 

By virtue of all the above, the discrete-time system (4.120) satisfies Hypothe- 
ses (Ll-3) in Sect. 1.7. Using induction and the weak semigroup property for E, it 
can be easily shown that, for every sequence {di]flQ e CMd, the solution of (4.120) 
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with initial condition x/^, — xq e FX and corresponding to input [d, }^q e CMp and 
Ui = for all (■ > /o satisfies, for all i >io+ I, 

{(PiO-r + Ti, r,„, xo(r), mq, Pd) 9 e [r - T^ + 7^_i, r] 
Xi = (4.121) 

[O 9e[0,r-Ti + Ti-i] 

where P^ : S)i+ ^ £» with Pd(t) := £/,(0 for all ?;• < f < 7;+i, / = 0, 1, 2, . . . , 
which by Hypothesis (CONl) belongs to Md- Moreover, using (4.1 19) in conjunc- 
tion with (4.121), we obtain, for all / > /q + 1, 

II J'/IIfy <(T{piT,,)\\xi4Fx, max{0; Ti - Ti, - r}) (4.122) 

Estimate (4.122) implies that system (4.120) satisfies the Robust Output Attractivity 
Property (P3) of Definition 2.2. Thus by Lemmas 1.3, 1.4, and 2.1, system (4.120) 
is RGAOS. Consequently, by virtue of Proposition 4.6 and Properties (CON3), 
(C0N4) above (which imply Hypotheses (Ll-5) for (4.120)), we conclude that the 
discrete-time system (4.120) satisfies the WIOS property. 

Since the discrete-time system (4.120) satisfies the WIOS property, by Propo- 
sition 4.5, there exist functions ct e KL, P,y e K^ , and p e K^o such that for all 
{ui e MU]°^Q and (i'o, xq, {di]°^Q) e Z+ x FX x CMd, the following estimate holds 
for all i > ('o for the solution x,- of (4.120) with initial condition x,(, — xq and corre- 
sponding to inputs {ui}°Zo ^ CMU and {di}°^Q e CMd'- 

\\H(i,Xi)\\^^<mcix\&{P(io)\\xo\\px,i -h), 

sup a(p(Y(j)sup\\uj(r)\L),i - j)\ (4.123) 

•0<j<' r>0 ^ ^ ' 

Part 2: Proof of estimate (4. 114) 

Notice that definition (4. 1 17) of the evolution map / of the discrete-time system 
shows that the solution x; of (4.120) with arbitrary initial condition x,q — xq and 
corresponding to arbitrary inputs {M,}^g e CMU and {dj}°^Q e CMj) coincides, 
for all i > io + I, with the solution with arbitrary initial condition x,p that satisfies 
x,Q(r) = xo(r) corresponding to inputs {ii/}^Q e CMo and {M(}™o e CMU with 
Uj{t) — Uj(t) for all t e [Tj, Tj^i] and j — /q, io + 1, . . . ,i — 1. Thus by (4.123) 
it follows that for all {w; e M[/}~o and(!o,xo, {4}~o) e 2+ x FX x CMd, the 
following estimate holds for all ( >io+l for the solution x, of (4.120) with initial 
condition x/^ — xq and corresponding to inputs {m;},^o e CMU and {di}f^Q e CMd'- 

||^(',-^i)||pY <maxjcr(;S(/o)||xo(r)||_;^,,/ - io), 

sup aipivU) sup ||m/.j)|L),/ - n! (4.124) 

io<j<i-[ ^ ^ Tj<s<Tj + i ' '^ 

Let arbitrary (d,u) e Md x Mt/, (fo-^o) ^ ■W'*' x A" and consider the transition 
map (p{t,to,xo,u,d) of i7 . The definitions (4.117) and (4. 1 1 9) of the evolution and 
output maps /, H of the discrete-time system (4. 120) implies that the transition map 
4>(t,to,xo,u,d) of i7 satisfies the following identities for all / > i'o + 1: 
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x(t) = (l>(t, to, xo, u, d) ^Xi{t + r- Ti) Vf e [7^-1, 7^] 

F(0 = H{t, (t){t, to, xo, u, d)) ^Yiit + r- Ti) Vf e [7^_i, Ti] 

where 7]^ — q„(to), and x, denotes the solution of (4.120) with arbitrary initial 
condition .t,q e FX that satisfies x/p(r) — (j)(Ti^^,to,xo,u,d) and corresponding to 
the constant inputs {m, = m}^o ^ CMU and {c?, = <jf}^o ^ CM/). Combining the 
above identities with (4.125), we obtain, for all / > ('o + 1, 



7;_i<r<r, 



sup ||y(0|L <max CT(yS(/o)||x,-(,(r)||^,i -io), 

\<t<Ti ' 

sup aipifU) sup ||«W|L),'-y) 

(4.125) 

Let P,y e K^ be nondecreasing functions that satisfy PiTj-i) > ^(j) and 
y(Tj) > y(j) for all integers 7 > 1. Estimate (4.125), in conjunction with the trivial 
inequalities Tj^ — r < to < Tj^ and the causality property for E (which shows that 
Y(t) depends only on the values of m e MU in the interval [fo, ?]), implies (notice 
that without loss of generality we may assume that g{s, t) is of class Koo for each 
f >0) 



[^(f)!!^ <max 



II II t — tO' 

o-( /S(fo)p(7^o)|lA'' 



sup a(p(y(r)||M(r)|L ),^^ — -]\ ^t>to + r (4.126) 
,<T<r V " r J] 



Without loss of generality, we may assume that the function /x e K~^ involved 
in (4. 1 15) is nondecreasing. Inequality (4. 1 15), in conjunction with (4. 126), implies 
the following estimate for all f > fo + '" : 

||y(r)|L <max 



/ - / II II \ ^ ~ fo ~ 

a[P(to)iJ.(to + r)a(\\xo\\x+ sup M(r) L , 

V ^ to<T<t "/ r 

sup a(p{y(r)\\u(r)\\ ),'-^^)\ (4.127) 

to<T<t \ r J \ 



It follows from Hypothesis (C0N2) in conjunction with the fact that for every 
bounded set S C Bt"'" x X, the set H{S) is bounded and Lemma 2.3 that there exists 
a pair of functions ^ e K^ and & e K'^ such that 

\H{t,x)\y<^[8(t)\\x\\x) V(f,x)eS)i+ X A" (4.128) 

Without loss of generality we may assume that the function & e K^ involved 
in (4.128) is nondecreasing. Combining the above inequality with estimate (4.115), 
it follows that, for all t e [to, to + r], 

\\Y{t)\\y<^(s{to + r)f^(to + r)a(\\xo\\x+ sup ||M(r)|L)) (4.129) 

•^ ^ \ to<T<t '' 
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Defining 

co(s,t):^sxpir-t)^(s)+\ \ ' ' ^. ^ ^, .,^ (4.130) 

I exp(r-f)cr(^,0) ifO<f<r 

^(0 := p{t){l + fi(t + r)) + S{t + r)ii(t + r) (4.131) 

and combining estimates (4.127) and (4.129), we obtain the following estimate for 
all t > ?o: 

||j'(0||3;<max|tti(^;S(ro)aM|xo||A'+ sup \u{x)\^y t - t^A , 

sup (w(p(y(r)||M(T)|L), f — t) [ (4.132) 

l0<T<t > 

Lemma 2.3 implies the existence of a pair of nondecreasing functions a e Koc and 
q e K+ such that P{t)a{2s) < a{q{t)s) for all t,s>0. Since, for all t > fo, 

w[P(tQ)ai\\xo\\x+ sup ||M(r)|L),f-fo) 

^ ^ to<T<t ' ' 

<max!&)(j6(fo)fl(2||xo||A'),?-?o),«(y6(fo)a(^2 sup ||m(t)||^J, f - fojj 

'''^''^' (4.133) 

and p{t)a{2s) < a(q{t)s) for all t,s >Q with q e K'^ being nondecreasing, 
from (4.133) we obtain 

co(p(to)a(\\xo\\x+ sup ||M(r)|L),r-ro) 
^ ^ ro<T<t ' ' 

< max!(y(^(ro)||xo||A':? — ^o), sup a)(g(T)||M(T)|L, r — r) [ (4.134) 

where a)(j,f) := w («(.?),/)■ Finally, let j6(0 := \^q(t) + fi{t),a{s,t) :=(w(i,r) + 
a)(i, t), p{s) \— s + pis), and yit) \— y(t) + q{t). The previous definitions, in con- 
junction with (4.132) and (4.134), imply estimate (4.1 14). 

The proof is complete. D 

It should be noticed that for systems satisfying Hypotheses (CONl), (CON2), 
and (G), Theorem 4.1 gives qualitative characterizations for the WIOS property 
which cannot be further weakened. On the other hand. Example 4.3.2 shows that 
the result cannot be extended to the lOS property. 



4.7 Lyapunov-Like Necessary and Sufficient Conditions for 
WIOS 

The main purpose of this section is to present necessary and sufficient Lyapunov- 
like conditions for WIOS and lOS for certain types of systems. We start with the 
finite-dimensional case. 
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4.7.1 Control Systems Described by ODEs 

In this section, we will restrict our attention to systems for which the output map is 
independent of the values of the input, i.e., H{t, x,u) — Hit, x). 

Theorem 4.2 Consider system (1.3) under Hypotheses (Y{\-5) and suppose that H : 
d\~^ X d\" —>■ S)i is locally Lipschitz and independent of u e U . Moreover, suppose 
that the following hypotheses hold: 

(H6) For every bounded I C J)t+ and for every bounded S C St" x U , there exists a 
constant L >0 such that 

\f(t,x,u,d) — f(t,x,v,d)\ <L|m — i>| 

Vf e /, V(x, u,x,v)eS X S,WdeD 

(H7) U is a cone, i.e., for all u e U and A. > 0, it follows that (Am) e U . Then, the 
following statements are equivalent: 

(a) System (1.3) is robustly forward complete (RFC) from the input u e Mj/, 
and there exist functions a e KL, P, S e K'^ , and ^ & K such that for all 
(d, u) e Md X Mjj and (to, xq) e d\~^ x di", the solution x(t) o/(1.3) with 
x(to) — XQ corresponding to (d, u) € Mo x Mj/ satisfies the following 
estimate for all t >tQ: 

\H{t,xit))\ 

<maxJCT(;S(fo)ko|,f-fo), sup CT(^(3(r)|M(T)|), ?- r)}. (4.135) 

(b) System (1.3) satisfies the WIOS property from the input u € Mu . 

(c) There exist a locally Lipschitz function 6 € ^oo and functions 4>, /a. e K'^ 
such that the following system is RGAOS: 

i(f) = /(f,jc(f),— ^— -^<i'(0,<i(0 I Y(t)^H{t,x(t)) (4.136) 

where A := Bc/[0, 1] x D, H(t, x) := (H(t, x), ii(t)x) e Dt* x m". 

(d) There exist a locally Lipschitz Lyapunov function V : Df"*" x Dt" — > Dt"*", 
functions ai, 02, 03 of class Kqo, and /S, S, ji of class A""*" such that 

ai{\H(t, x)\ + fi(t)\x\) < V{t,x) < a2{P{t)\x\) 

V(f,x)e*W+ xSW" (4.137) 

V^{t,x;f{t,x,u,d))<-V(t,x)+a3(8{t)\u\) 
'¥(t,x,u,d)edi+ xdi" xU X D (4.138) 

(e) System (1.3) is RFC from the input u e Mjj, and there exist a locally Lip- 
schitz Lyapunov function V : di'^ X di" -^ 9i'^ , functions ai, a2, ^ of class 
Koo, P,S of class A""*", and a locally Lipschitz positive definite function 
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p : *){+ ^ Dt+ such that 

ai{\H{t,x)\)<Vit,x)<a2{liit)\x\) 

V(f,jc)e9{+ xSir (4.139) 

y°(f , x\ fit, X, u, d)) < -p{V(t, x)) 

V(f,jc,M,^)e9{+ xdi" xU X Dwith^{8(t)\u\) < V(t,x) 

(4.140) 

(f) System (1.3) is RFC from the input u e Mj/, and system (1.3) w/f/i m = 
is RGAOS. 

Moreover, if there exist functions p e K^ and fi € A""*" awJ a constant R >0 such 
that p{fj,{t)\x\) < V(t,x) + R for all (t,x) e DJ"*" x 9t", f/ien the requirement that 
(1.3) /.? RFC from the input u e Mjj is not needed in statement (e) above. 

The proof of Theorein 4.2 relies on the following lemma, which shows how Lya- 
punov functions can be used in order to prove the WIOS property and determine the 
weight and gain functions. 

Lemma 4.7 Consider system (1.3) under Hypotheses (Hl-4) and suppose that it is 
RFC from the input u e My . Furthermore, suppose that there exist locally Lipschitz 
functions V : M"*" x 9{" — >■ Sit"*", ai, aj, i, of class Koo, /S, 8 of class A""*", anda locally 
Lipschitz positive definite function p : Di"*" — >• Sit"*" such that inequalities (4.139), 
(4.140) hold. 

Then, system (1.3) satisfies the WIOS property with gain y(.s) :— flj~ {^{s)) and 
weight 5. Furthermore, there exists a e KL such that statement (a) of Theorem 4.2 
holds. Moreover, if fi{t) = 1, then (1.3) satisfies the UWIOS property with gain 
y(s) :— flj" (^(i)) and weight S. Finally, if there exist functions a e K^ and jx e 
K~^ anda constant R>0 such that a{fi(t)\x\) < V(t,x) + R for all {t,x) e Dt"*" x 
SE", then, the requirement that (1.3) is RFC from the input u e Mj/ is not needed. 

Proof Consider a solution x{t) of (1.3) under Hypotheses (Hl-4) corresponding to 
arbitrary {d, u) e Mo x Mjj with initial condition x(fo) = xq e Hi". Clearly, the so- 
lution exists for t e [fo, fmax), where rmax e (fo, +oo] is the maximal existence time 
of the solution. Notice that the mapping t -^ V{t,x(t)) is absolutely continuous on 
[to, fmax) and we have 

— V{t,x(t))^V°{t,x(ty,f{t,x(t),u(t),dit))) a.e. on [ro, Wx) (4.141) 

where V^(t,x; v) := limsup;,^o+ "''"^^"""^f ^""^'""^ Indeed, notice that, for all 
t e [tQ,taiax)\l, where / C [toJm-dx) is the set of zero Lebesgue measure such 
that D+x(0 = limf,^Q+ h~^(x(t + h) - x(t)), or ^V(t,x(t)) is not defined on 
/, or D'^x{t) ^ f(t,x(t), u(t), d(t)), we get, for all sufficiently small h > and all 
f e[fo,fmax)\/, 

x{t + h)-x(t)-hD+x{t)^hyh (4.142) 
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where 

xit + h)-x(t) . 

yii = ; D^x(t) 

h 

Since lim,,^o+ -^'^+^^~-'^^^ = D+x{t), we obtain that y/, ^ as /; ^ 0+. Notice 
that since V : di~^ x i)i" -^ di~^ is locally Lipschitz, we have 

y (f , x{t); D^x(t)) — limsup 

V(t + h, x(t) + hD+x{t) + hyh) - V{t, x{t)) 
— lim sup 

The above equality, in conjunction with (4.142) and the facts that jjV(t,x(t)) — 
limsup;,^o+ v(t+h,^(t+h))-V(t.^(t)) ^^^ D+x(t) = f{t,x(t),u(t),d(t)) for all t e 
[fo,Wx)\/, implies (4.141). 

It follows from Lemma 2.14 and inequalities (4.140), (4.141) that there exists 
a e KL with a-{s,0) — s for all i > such that, for all t e [Iq, fmax); 

V{t,x{t))<max\a{V(tQ,xo),t-to), sup a{^{S(r)\u(r)\),t - t)\ (4.143) 

^ tQ<T<t ' 

Next, we distinguish the following cases: 

1. If (1.3) is RFC, then (4.143) holds for all t > to- It follows from (4.143) 
and (4.139) that (4.1) holds with y(s) := a~\^{s)) (recall that ais, 0) ^ s for 
all s > 0). Moreover, it follows from (4.143) and (4.139) that statement (a) of 
Theorem 4.2 holds with a(s, t) :— flj~ (d(a2(s), t)). 

2. If there exist functions a e Koc and fi e K^ and a constant ^ > such that 
a(/i(r)|x|) < V(t, x) + R for all (?, x) e !H+ x di", then (4.143), in conjunction 
with (4.139) and the fact that a{s, 0) — s for all s >0, implies the following 
estimate: 

\xit)\<—-a-^(R + a2{P(to)\xo\)+ sup ^{S(r)\u(r)\)) (4.144) 
M(') ^ to<T<t ' 

for all t e [fo>fmax)- Estimate (4.144), in conjunction with the BIC property, 
implies that fmax = +oo. Moreover, (4.144) and Definition 1.4 show that sys- 
tem (1.3) is RFC from the input u e Mjj, since we have, for all r,T >0, 

m^\\x(tQ + s)\\s e [0, T], \xq\ < r, fo e [0, T], (d,u) e Md x Mu, 

sup |M(r)| < r\ 

< a~^(R + a2(rmaxP(t)) +^(rmax S(t))) < +oo 

rmno<, <2T lJ-{t) V Vo<r<r / Vo<r<2r // 

The proof is complete. D 

Proof of Theorem 4.2 We prove implications (a) =► (b), (b) => (c), (c) =► (d), 
(d) =► (e), and (e) =► (a). The equivalence between (f) and (b) is a direct conse- 
quence of Theorem 4. 1 . 
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(a) =^ (b): Suppose that there exist functions a e KL, P,S e K~^, C, e K^ such 
that the estimate (4.135) holds for all (cf, u)eMD x Mu, (to, xq) e S1t+ x di" and 
t > tQ.lfwe set y{s) :— a{^(s), 0) (that obviously is of class A/"), the desired (4.1) 
is a consequence of (4.135) and the previous definition. Thus statement (b) holds. 

(b) =► (c): By virtue of Corollary 4.1 and Hypothesis (H7), it follows that the 
system 

i(t)^f{t,x(t),v(t)d'(t),d(t)) Y(t)^H{t,x{t)) (4.145) 

where A := Bu[Q, 1] x D, H{t,x) := (H{t,x), i^(t)x) e M* x di", and i; e M;ij+ 
satisfies the WIOS property from the input i; e Mgj+ . More specifically, there exist 
functions /i, P,S e K~^, a e KL, and y eAf such that (4.42) holds for the solutions 
of (4.145) for all v e M3J+, (to, xq, (d', d)) e 9J+ x X x M^, and t > Iq. Without 
loss of generality we may assume that y e K^o- By virtue of Lemma 3.2 we obtain 
that there exists k e Koo such that y{rs) < K(r)K(s) for all (r,s) e (Di"*")^. Let 
(f>(t) :— S(t)K~^(/^^), and let 9 e Koo be a locally Lipschitz function that satisfies 
0(s) < K~^(s) for all 5 > 0. The previous definitions imply that 

0(1x1) 1 ,//x(0 \ -u 

W-^^ ( 2 1^1) V(^x)eDt+xDr (4.146) 

Finally, the reader should notice that system (4.136) is the feedback interconnec- 
tion of system (4.145) with the static map v{t) :— Iq) ■ The result follows from 
Proposition 4.3 and inequality (4.146). 

(c) ^ (d): Suppose that (4.136) is RGAOS. Hypotheses (Hl-7) for system (1.3) 
guarantee that Hypotheses (Hl-5) hold for system (4.136). Therefore, Theorem 3.5 
implies that there exists a locally Lipschitz mapping (f , x) e !){"*" x !){" -^ V(t, x) e 
di~^ with the following properties: 

- There exist functions ai, 02 e A'oo and /J e K'^ such that (4.137) holds. 

- It holds that 

V°(t,x;f(t,x,-^d',d]] <-V(t,x) 
V ''V 0(0 JJ~ 

'^{t,x,d',d)em+ xm" X A. (4.147) 

Notice that inequality (4.147) implies the following inequality: 

V°{t,x;f(t,x,u,d)) <-V{t,x) 

V(f,x,M,J)eS)i+ X m" xU X D with (t>(t)\u\ <e{\x\) (4.148) 

Using definition (2.128) and Hypothesis (H6), we obtain, for all (t, x, u, d) e di~^ x 
m" xU X D, 

I y°(f , x; fit, X, u, d)) - V^[t, x; f(t, x, 0, d)) \<M{t + \x\ + \u\)\u\ (4.149) 

for certain nondecreasing function M : d\~^ -^ d\~^ . Define 

\l/(t,s):^sup{M{t + \x\ + \u\)\u\; \x\ <e~\(l)(t)s),\u\ <s} (4.150) 

Without loss of generality we may assume that the function (p e K'^ is nondecreas- 
ing. Clearly, \[r : d\~^ x d\~^ -^ di~^ is a mapping with \jf{t,Q) —Q for all r > and 
such that 
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(i) for each fixed f > 0, the mapping i/^ (f , ■) is nondecreasing; 
(ii) for each fixed 5 > 0, the mapping \l/(-,s) is nondecreasing; and 
(iii) limj^o+ V^(^ ^) = for all t > 0. 

Hence, by employing Lemma 2.3 we obtain functions 03 e Koo and S e K^ such 
that if(t,s) <ai,(S{t)s). 

We next establish inequality (4.138), with 03 as previously, by considering the 
following two cases: 

• 0~^((l>(t)\u\) < \x\. In this case inequality (4.138) is a direct consequence 
of (4. 148). 

• 0~^((l){t)\u\) > |x|. In this case, by virtue of inequalities (4.148), (4.149), defini- 
tion (4.150), and the definition of 03, we have 

y°(f , x; fit, X, u, d)) < V°{t, x; f(t, x, 0, d)) + f{t, \u\) 
<-V(t,x)+a3{&{t)\u\) 
which implies (4.138). 

(d) => (e): Notice that (4.138) implies (4.140) with ^{s) := la^is) and p{s) := 
ji'. The fact that system (1.3) is RFC from the input u e My follows directly from 
Lemma 4.7. 

(e) =^ (a): Follows directly from Lemma 4.7. 

The proof is complete. D 

Next, we present necessary and sufficient conditions for the UIOS property. 

Theorem 4.3 Consider system (1.3) under Hypotheses (Hl-7) and suppose that 
H : Dt"*" X S){" — >■ S1{ is locally Lipschitz and independent of u e U . Moreover, sup- 
pose that (1.3) is T -periodic and that Hypothesis (G2) holds. Then the following 
statements are equivalent: 

(a) System (1.3) is robustly forward complete (RFC) /rom the input u e Mij, and 
there exist functions a e KL and f e A" such that for all (d, u) e Mo x Mtj and 
(to, xq) e Di"*" X d\" , the solution x(t) o/(1.3) with x(?o) = xq corresponding to 
(d, u) e Md X Mu satisfies estimate (4.135) with P(t) — S(t) = I for all t > tQ. 

(b) System (1.3) satisfies the UIOS property from the input u e Mjj . 

(c) There exist a locally Lipschitz function 6 e Koo and functions 0, /x G K'^ such 
that the following system is RGAOS: 

i(t)^ f{t,x(t),e{\H(t,x)\)d'{t),d(t)) Y(t)^H{t,x{t)) (4.151) 

where A:^Bv[0, 1] x D. 

(d) There exist a T -periodic locally Lipschitz Lyapunov function V : Si"*" x 9t" — >■ 
Dt"*" and functions a\,a2,a}, of class Kqq such that 

ai{\H{t,x)\)<V{t,x)<a2[\x\) V(f,x) e 9t+ x DT (4.152) 
y°(f , x; fit, X, u, d)) < -V(t, x) + fl3(|M|) 
V(f,x,M,J)eSW+ x!ir xU X D. (4.153) 
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(e) There exist a locally Lipschitz Lyapunov function V : Di"*" x !1{" — >• dl'^ , func- 
tions fli,fl2>^ of class KoQ, and a locally Lipschitz positive definite function 
p : 9{+ -^ Dt+ such that 

ai{\H{t,x)\)<Vit,x)<a2{\x\) V(r,x) e 9{+ x M" (4.154) 

y°(f , x; fit, X, u, d)) < -p{V(t, x)) 
V(f,;c,M,£/)e9i+ xdi" xU X Dwith^{\u\)< V(t,x). (4.155) 

Proof of Theorem 4.3 We prove implications (b) =► (c), (c) =► (d). All other impli- 
cations are proved in exactly the same way as in the proof of Theorem 4.2. 

(b) => (c): By Hypothesis (H7) it follows that the system 

iit)^f{t,x(t),vit)d'it),d(t)) Y(t)^H{t,x(t)) (4.156) 

where A :— 5c/ [0, 1] x D and v e M;ij+, satisfies the UIOS property from the input 
V e M;ij+ . More specifically, there exist functions a e KL and y eAf such that (4.2) 
holds with /6(f) = 1 for the solutions of (4.156) for all v e M3i+, (to, xq, {d', d)) e 
di~^ X X X Ma , and f > fo- Without loss of generality we may assume that y e Kqc . 
Let 6 e Koo be a locally Lipschitz function that satisfies 6{s) < /"Hj'S) for all 
s >0. The previous definitions imply that 

d{\H(t,x)\)<y-H-\H(t,x)\\ V(f,jc)eS1{+ xSli" (4.157) 

Finally, notice that system (4. 15 1) is the feedback interconnection of system (4. 156) 
with the static map v{t) :— 9(\H(t, x{t))\). The result follows from Proposition 4.4 
and inequality (4.157). 

(c) ^ (d): Suppose that (4.151) is URGAOS. Hypotheses (Hl-7) for system (1.3) 
guarantee that Hypotheses (Hl-5) hold for system (4.151). Therefore, Theorem 3.5 
implies that there exists a T-periodic locally Lipschitz mapping (t,x) e Di"*" x Of -^ 
V{t, x) e Dt"*" with the following properties: 

- there exist functions a\,a2& Koo such that (4. 152) holds. 

- it holds that, for all (f , x, d' , d) e i)i+ x i)J" x A, 

V^{t,x; f{t,x,e{\H{t,x)\)d',d)) <-V{t,x). (4.158) 

Notice that inequality (4.158) implies the following inequality: 

V°(f,x; f(t,x,u,d)) < -V{t,x) 
V(f,x,M,d)eS)i+ X m" xU X £) with|M| <e{\H(t,x)\) (4.159) 

Using definition (2.128), the facts that (1.3) is T-periodic and that V is T-periodic 
and Hypothesis (H6), we obtain, for all (t,x,u,d) e S)i+ x di" x U x D, 

\v'^{t,x;f(t,x,u,d))-V°{t,x;fit,x,0,d))\ < M(|x| + |m|)|m| (4.160) 

for certain nondecreasing function M : d\~^ -^ SH"*" . Define 

i^is) := sup{M(|x| + |m|)|m|; \x\ < a{9~\s)) + P, \u\ < s} (4.161) 
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where a e K^o and P > are the function and constant, respectively, involved in 
Hypothesis (Gl). By employing Lemma 2.4, we obtain a function 03 e K^q such 
that i/f(.j) <a3(s). 

We next establish inequality (4.153), with aj, as previously, by considering the 
following two cases: 

• |m| < 6(\H(t,x)\). In this case inequality (4.153) is a direct consequence 
of (4. 159). 

• |m| > ()(\Hit,x)\). In this case, by virtue of inequalities (4.159), (4.160), def- 
inition (4.161), Hypothesis (Gl), and the definition of 03, we have V'^{t,x; 
fit,x,u,d))<V°(t,x; fit,x,0,d)) + i/(\u\) < -y(f,jc) +a3(|M|), which im- 
plies (4.153). 

The proof is complete. D 

Using Proposition 4.2 and Theorem 4.2, we obtain the following characterization 
for the RFC property from the input u e Mfj . 

Corollary 4.2 Consider system (1.3) under Hypotheses (Hl-3) and (H5-7). Then 
the following statements are equivalent: 

(a) System (1.3) is robustly forward complete (RFC) from the input u e Mj/. 

(b) There exist a locally Lipschitz function V : Ot"*" x S)i" — >• ^H'^ , functions ai, a2, 
03 of class Koc, and P, S, fi of class K'^ such that 

ai{ixit)\x\)<V(t,x)<a2{Pit)\x\) V(r, x) e !H+ x *){" (4.162) 
y°(f,x; f(t,x,u,d)) < -V(t,x) + a3{Sit)\u\) 
'i(t,x,u,d)edi+ xdi" xU X D. (4.163) 

(c) There exist a locally Lipschitz function V : dl'^ x S){" — >• dl'^ , functions a\, 02, 
03 of class A'oo, and fi, S, fj., p, q of class K'^ such that 

ai{fiit)\x\) - pit) < V{t, x) < a2{P{t)\x\) + pit), 

V(f,x)eDi+ xSir (4.164) 

V^{t,x; fit,x,u,d)) < {qit)+a3{Sit)\u\))Vit,x) + a3{Sit)\u\) 

V(f , X, u, d) e di+ X m" xU X D. (4.165) 

Proof The equivalence between (a) and (b) is a direct consequence of Proposi- 
tion 4.2 and Theorem 4.2. Implication (b) =^ (c) is obvious. We prove implication 
(c) ^ (a). 

Let T, R >0 arbitrary and consider the solution x(f) of (1.3) corresponding to 
arbitrary id,u) e Md x Mu with initial condition xito) — xq e di" with to e[0,T] 
satisfying |xo| < R, sup,>o \uit)\ < R. Clearly, the solution exists for t e [to, fmax), 
where t^nax e ito, +00] is the maximal existence time of the solution. Exactly as in 
the proof of Lemma 4.7 and using (4.165), we may establish that, for almost all 

t e [fo, ?max), 
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— V{t,xit))<{qit)+a3{S{t)R))V{t,xit)) + a3{8(t)R) (4.166) 
For all t e [to, to+T]n [to, rmax), it follows from (4.166) that 

— V{t,x{t))<A(T,R)V{t,x(t)) + B(T,R) a.e. on [fo, Wx) (4.167) 



where 



A(T,R):^ max (0(0 + 03(^(0^)) and 
0<r<27-^ ^ " 



B(T,R):^ max 03(8(1) R). 

0<t<2T ^ ' 

Using the absolutely continuous function W(t) :— exp(— (r — to)A{T, R))V(t,x(t)) 
and (4.167), we estabhsh that, for all t e [to, to+T]r\ [to, fmax), it holds that 

-W(t)<exp{-(t-to)A(T,R))B(T,R) a.e. on[fo,rmax) (4.168) 

Using the fact that W(t) :— exp(-(r - to)A(T, R))V{t,x(t)) is absolutely continu- 
ous and (4.168), we obtain 

V{t, x(t)) < txp{TA(T, R))V(to, xo) + exp(r A(r, R)) ^i^' ^ 

A(I , R) 

for all te[to,to + T]n [to, Wx) (4. 169) 

Finally, using (4.164) and (4.169), we obtain 

ai{fi(t)\x(t)\)<p{t) + exp{TA(T,R))Q(T,R) + exp{TA(T,R))^^^^j^ 

A(I , R) 

for all f e [fo , ro + r] n [fo , Wx) (4.170) 

where Q{T, R) := maxo<f<r(/7(0 + a2(P(t)R)). Using (4.170) and the BIC prop- 
erty, we can establish that t^ax — +00. Moreover, using (4.170) and Definition 1.4, 
we establish that (1.3) is robustly forward complete (RFC) from the input u e Mu. 
The proof is complete. D 

The following example shows how we can utilize Lemma 4.7 in order to prove 
the UISS property. 

Example 4. 7. 1 (The chemostat with time-varying dilution rate) Here we consider 
again the chemostat with one microbial species and one nutrient, already studied in 
Example 1.2.1 with Monod specific growth rate, i.e., 

At(^) = -^^ (4.171) 

k + s 

where a,k> Q are positive constants, zero mortality rate (i.e., b — 0), constant 
yield coefficient (i.e., K(s) = K > 0), and constant inlet nutrient concentration 

(i.e., Si„(t) = s*^ > 0). If < D* < ^qrr, then there exists a unique vector 
{X*, s*) e (0, +00) X (0, +00) satisfying the equilibrium conditions (1.5). There- 
fore, model (1.7) takes the form 
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a 



XI 



exp(x2) - 1 
I 

p + exp(x2) 



11 



X2 = — ^^(1 + i')exp(-X2)(l - exp(x2)) 



P+1 
aM 



exp(-X2) 



(p+ l)exp(xi +X2)' 



p + exp(x2) 



X — (xi,x2) e dr, i; e [— 1, +oo) 



(4.172) 



where v 



D-D* 

D* 



and p = -^. It should be noticed that the "unforced" sys- 



tem (4.172) (i.e., system (4.172) with ii = 0) is URGAS in this case. The analysis 
presented in Example 2.7.3 holds (because the Monod specific growth rate defined 
by (4.171) is a strictly increasing function). More specifically, the Lyapunov func- 
tion defined by (2. 158) takes the simple form 



V(x) — exp(xi) — xi — 1 



M(p + 1) 



(exp(x2) - X2 - 1) 



+ e(Mexp(xi) + exp(x2) - 1 - M)' 



(4.173) 



where Q > is arbitrary. The derivative V'(x) of V along the trajectories of (4.172) 
is given by the following expression: 



1 



-y(x) = 



p 



1 



exp(-X2)(l-exp(x2)) 



M p + exp(x2) _ 
-(exp(x2) - l) exp(-X2)ii - (exp(xi) - l)v 

2e(l + i;)(Mexp(xi) + exp(x2)- 1 - Mf 



(4.174) 



Here, we will study the robustness properties of system (4.172) with respect to the 
external input ii e [—1, +oo). It should be noted that if v is allowed to take values 
greater than p, then we obtain from (4.172) that xi < — "^"~P' . The previous dif- 
ferential inequality shows that xi(f) can be unbounded for a constant input, which 
shows that the UISS property from the input v e [—1, +cxd) cannot hold for sys- 
tem (4.172). 

Therefore, we will try to show that the uniform ISS property holds when i; is 
restricted to take values in an appropriate interval (—1 + A, B), where the constants 
A e (0, 1) and B > satisfy A(l + ^) < 1 and B > ^. The following inequal- 
ity is a direct consequence of (4. 174) and the fact that v + 1 > A: 



1 



■V(x)< 



VI p 
exp(-X2) 



exp(x2) 
1 
M 



(Mexp(xi) + exp(x2) — 1 — M) 



exp(-X2)(l-exp(x2)) 
(exp(x2)- l)t; 



M 



2eA(Mexp(xi) +exp(x2) - 1 - M) 



(4.175) 
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C(X2) : = 



p+l^ , ., ^ , ,x [^+e'^Pfe)]^ 



pM 



{pe\p(-X2)+ 1) 



(A + M)p + A exp(x2) 



(4.176) 



V 

M 



Using the inequalities 

-(Mexp(xi) + exp(x2) - 1 - M)- 

iVl 

< gA(Mexp(jci) + exp(x2)- 1 - M)^ 
P 



1 



4M^QA 



1 

exp(-X2) + — 
p+l M 



cfe) 



1 



(exp(x2)- 1)1; 



P 1 ' 

— — exp(-X2) + — 
p+l M 



(exp(x2) - 1) 



2 2c (X2) 

and definition (4.176), it follows from (4.175) that the following inequality holds: 



1 



-V(x)< 



M p + exp(x2) 

,2 



2(p+l) 
— gA(M exp(xi) + exp(x2) — 1 — M) 



exp(-X2)(l-exp(x2)) 



(4.177) 



Define the functions 



<J(X2):= 



1 



■ C(X2) 



p+l\2M^QA 
X exp(-X2)(l - exp(x2)) 
1 



M ;? + exp(x2) 



P(x) = 0(x2) + 2eA 



2M2gA 



■ C(X2) 



X (Mexp(xi) + exp(x2) — 1 - M) 
and notice that definitions (4.176), (4.178) imply that limj^j^+oo 't'{x2) ■ 



(4.178) 



(4.179) 



_aV_ 



and hm^,_ 



:1>{X2) 






(p+1)^ 



> 0. Moreover, notice that 0{x2) > for all 



X2 / and P{x) > for all x^O. 

Therefore, if a sequence {|,- e 1^^^}f^Q satisfies P(t/) -^ 0, then we must neces- 
sarily have ^, ^- e di^. It follows that 



r](s) := infyP(x) : x e df, V(x) > . 



(4.180) 



is a nondecreasing function which satisfies ri(Q) = 0, rj(s) > for all s > 0, 
and limj^_|_oo ??(«) — L < —^. The reader should notice that definitions (4.178), 
(4.180), in conjunction with inequality (4.177), show that the following implication 
holds for every Xe (0, 1): 
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\v\<Xr]{Vix)) and vei-l + A,B) 

^ V(x)<-- -{ . +c(x2))P{x) (4.181) 

a 2 \2M^QA ^ ^' j ^ ' 

Since linis^ +00 ^{s) — L < —A, the inclusion v e {—\ + A, B) holds automatically 
if \v\ < XriiVix)), A(l + ^) < 1, and B > A^. 
Next, we consider the following input transformation: 

expfw) — 1 

v^XL^—^ withuejn (4.182) 

1 + exp(M) 

Implication (4.181) and definition (4.182) imply the following implication: 

?{\u\)<V(x) 



where i; eKoois defined hy^{s) := ^"Hi-fq^^), and fj(s) := ;^ /J ?7(i(;) ofw is 
a strictly increasing, continuous function with lim^^-i-oo ??(■?) = L and J7(i') < ?7(i') 
for all s>0. 

Proposition 2.2, in conjunction with Lemma 4.7 and implication (4.183), shows 
that the system 



a 

x\ = 



exp(jC2) - 1 , ^ exp(M) - 1 
p XL- 



/? + 1 L /' + exp(x2) 1 + exp(M) _ 

a ( exp(M) — 1\ , ^ 

x-i = — — - 1 + 'XL-- exp(-X2)(l - exp(x2)) 

p+l\ l + exp(M)/ 



aM 

+ — — r exp(-X2) 
p+l 



■ exp(M)-l (/7 + l)exp(xi +X2) 



1 + exp(M) p + exp(x2) 

satisfies the UISS property from the input u e di. 



x^ixux2)edf,uem (4.184) 



4. 7.2 Control Systems Described by RFDEs 

We consider systems described by uncertain time-varying RFDEs of the form (1.10), 
and we state characterizations for the WIOS property. We assume Hypotheses 
(Sl-5) as well as the following hypotheses: 

(S6) The mapping u ^ f{t,x,u,d) is Lipschitz on bounded sets, in the sense that 
for every bounded / C ;ii+ and for every bounded 5 C C''([— r, 0]; Sit") x U, 
there exists a constant Ljj >Q such that 

\f{t,x,u,d) — f{t,x,v,d)\ < Lu\u — v\ 
Vr e /, (x, u,x,v)eSxS,deD 
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Hypothesis (S6) is equivalent to the existence of a continuous function Lu : 
d\~^ X d\~^ -^ d\~^ such that for each fixed t >0, the mappings Lu(t, ■) and Lu{-,t) 
are nondecreasing, with the following property: 

\ f {t , X , u , d) — f {t , X , V , d)\ < Lu (t , \\x\\r + \u\ + \v{)\u — v\ 

V(r, X, d, u, V) e m+ X C°([-r, 0]; m") x DxU xU (4.185) 

(S7) [/ is a positive cone, i.e., for all u eU and A > 0, we have (Am) e U. 

Theorem 4.4 The following statements are equivalent for system (1.10) under Hy- 
potheses (Sl-7): 

(a) System (1.10) is robustly forward complete {RFC) from the input u e Mj/, 
and there exist functions a e KL, /S,(/> € K'^ , and p ^ K such that for all 
(d,u) e Md X Mu and {to,xo) e 9f + x C*'([-r, 0]; Dt"), the solution x{t) of 
(1.10) with Tr{tQ)x — xo corresponding to (d,u) e Mo x Mu satisfies the fol- 
lowing estimate for all t >to: 

\\H{t,TAt)x)\\y 
<max\(T{p(to)\\xo\\r,t -to), sup a(p((l>(r)\u(r)\),t - r)\ (4.186) 

(b) System (1.10) satisfies the WIOS property from the input u e Mu ■ 

(c) There exist a locally Lipschitz function e Koo and functions (p, /i e. K^ such 

that the following system is RGAOS: 

( eaTr{t)x\\r) , \ 

xit)^f[t,TAt).,^^^^d'it),dit)) ^^_^^^^ 

Y{t)^H(t,Tr{t)x) 

where A := B(/[0, 1] x D, H(t, x) := (Hit, x), /x(r)x) e 3^ x C°i[-r, 0]; di"). 

(d) There exist a Lyapunov functional V : d\'^ x C ([—r, 0]; S)t") —>■ di~^, which is 
almost Lipschitz on bounded sets, functions ai, aj, aj, of class Kqo, and fi, S, /x 
of class K'^ such that 

ai{\\H(t,x)\\y + ix(t)\\x\\r) < V(t,x)<a2{P(t)\\x\\r) 
V(r,x) e m+ X C^([-r,0]; m") (4.188) 

V°{t,x;f(t,x,u,d)) <-V(t,x)+a3{S(t)\u\) 
V(r, X, u, d)em+ X C°{[-r, 0]; m") x U x D (4.189) 

(e) System (1.10) is RFC from the input u e Mu, and there exist a Lyapunov func- 
tional V : d\~^ X C ([— r, 0]; dl") —>■ d\~^, which is almost Lipschitz on bounded 
sets, functions ai, aj, ^ of class Koc, P, & of class A""*", and a locally Lipschitz 
positive definite function p ; Dft"*" — >• Dft"*" such that 

ai{\H{t,x)\y)<y{t,x)<a2{p{t)\\x\\r) 

-iit, x) e m+ X C°{[-r, 0]; m") (4.190) 

V°{t, x; fit, X, u, d)) < -p{V{t, x)) 

'^(t,x,u,d)em+ X C°([-r,0];9ft") xU x D with ^{S(t)\u\) < V(t,x) 

(4.191) 

(f) System (1.10) is RFC from the input u e Mu and satisfies the Q-GAOS property. 
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Moreover, 

(i) If H : di~^ X C ([— r, 0]; !){") — >• 3^ w equivalent to the finite-dimensional con- 
tinuous mapping h : [— r, +oo) x M" -^ Sli/", f/ien inequality (4.190) in the 
above statement (e) can be replaced by the following inequality: 

ai{\h{t , x{0))\) < V(t,x)<a2{P(t)\\x\\r) 

V(r,x) eat+ X C°([-r,0]; di"). (4.192) 

(ii) If there exist functions a e Koo and fx, R E: A""*" iMc/z that a(fi{t)\x(0)\) < 
\\H(t,x)\\y + R(t) for all (t,x) e dl+ x C°([-r,0]; dl"), then the require- 
ment that (1.10) is RFC from the input u e Mu is not needed in statement (a) 
above. 

(iii) If there exist functions p e Koo cind n, R E A""*" such that p(fi(t)\x(0)\) < 
V {t , x) -\- R{t) for all {t , x) e 9{+ x C°([-r, 0]; di") , then the requirement that 
(1.10) is RFC from the input u e Mu is not needed in statement (e) above. 

In order to obtain characterizations of the UIOS property, we need an extra hy- 
pothesis for system (1.10). 

(S8) There exists a constant R>Q and a function a e Koo such that the inequality 

\\x\\r < a(\\H{t,x)\\y) + R holds for all (t,x) e m+ x C^([-r, 0]; m"). 

Hypothesis (S8) holds for the important case of the output map H(t,x) :— 
d(x(0), F); 6 e [—r, 0], where F C SH" is a compact set which contains e S)f', 
and d(x, F) denotes the distance of the point x e S){" from the set F C^i" ■ Notice 
that it is not required that 7^ C M" is positively invariant for (1.10) with m = 0. 

Hypothesis (S8) is essentially Hypothesis (G2) and allows us to provide charac- 
terizations for the UIOS property for periodic uncertain systems. 

Theorem 4.5 Suppose that system (1.10) under Hypotheses (Sl-8) is F -periodic. 
Fhe following statements are equivalent: 

(a) Fhere exist functions a e KL and p e K^o such that for all (d, u) e Mq x Mj/ 
and (to, xo) e dl+ x C°([-r, 0]; m"), the solution x(t) of (I.IO) with Fr(to)x = 
xo corresponding to (d,u) e Md x Mu satisfies the following estimate for all 
t>to: 



\H{t,FAt)x) 



\y 



<max|CT(||xo||,,f-fo), sup cr(p(|M(r)|), r - r)|. (4.193) 

^ to<r<t > 

(b) System (1.10) satisfies the UIOS property. 

(c) Fhere exists a locally Lipschitz function 9 e Koc such that e C {[—r, 0]; di") 
is URGAOS for the system: 

i{t) = f{t,Fr{t)x,e{\H{t,Fr{t)x)\\y)d'{t),d{t)), 

Y{t)^H(t,Fr{t)x) 
where A:^BulO, 1] x D. 
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(d) There exist a T -periodic Lyapunov functional V : di~^ x C ([— r, 0]; !){") — >• di~^, 
which is almost Lipschitz on bounded sets, and functions a[,a2,a^ of class K^o 
such that, for all (t, x, u, d) e m+ x C''([-r, 0]; m") x U x D, 

fli (II Hit, x) \\y) < V{t, x) < ajiWxWr) (4.195) 

V°{t,x;f(t,x,u,d)) <-V(t,x)+a3{\u\). (4.196) 

(e) There exist a Lyapunov functional V : di~^ x C {[—r, 0]; S1{") — >• SH"*", which is 
almost Lipschitz on bounded sets, functions a\,a2, ^ of class Koo, and a locally 
Lipschitz positive definite function p : S)?"*" — >• Dt"*" such that 

ai{\\Hit,x)\\y)<Vit,x)<a2{\\x\\r) 

W(t, x) e m+ X C°([-r, 0]; m") (4.197) 

V^{t,x; f(t,x,u,d)) < -p{V(t,x)) 

'i(t,x,u,d)em+ X C*'([-r,0];S1{") xU x D with I; {\u\) < V(t,x). 

(4.198) 

Finally, if H : Di"*" x C ([— r, 0]; W) —>■ y is equivalent to the finite-dimensional 
continuous T-periodic mapping h : [— r, +oo) x S)i" -^ 9t^, then inequalities 
(4.195) and (4.197) in the above statements (d) and (e), respectively, can be re- 
placed by the following inequality: 

ai{\h{t,x{Q))\)<V{t,x)<a2{\,x\\r) V(r,x)ei)i+ x C''([-r, 0]; 3{") (4.199) 

The following result provides sufficient Lyapunov-like conditions for the 
(U)WIOS property. The proof of implications (e) =► (a) of Theorem 4.4 and 
(e) =► (a) of Theorem 4.5 are based on the result of Theorem 4.6, which gives 
quantitative estimates of the solutions of (1.10) under Hypotheses (Sl-7). The gain 
functions and the weights of the WIOS property can be determined explicitly in 
terms of the functions involved in the assumptions of Theorem 4.6. 

Theorem 4.6 Consider system (1.10) under Hypotheses (Sl-7) and suppose that 
there exist a Lyapunov functional V : Dt"*" x C {[—r, 0]; 9{") —>■ M"*", which is almost 
Lipschitz on bounded sets, functions a,i, of class Kqc, P,S of class K^, and a 
locally Lipschitz positive definite function p : Di"*" — >• Sit"*" such that 

V(t,x)<a{p(t)\\x\\r) W(t,x)edi+ xC°{[-r,0];m") (4.200) 

V°{t, x; fit, X, u, d)) < -p{V(t, x)) 

'^it,x,u,d)em+ xC°{[-r,0];m") xU x D with ^{S(t)\u\) < V(t,x) 

(4.201) 

Moreover, suppose that one of the following holds: 

(a) system (1.10) is RFC from the input u e My, 

(b) there exist functions p e Kqq and /i, ^ € K'^ such that /7(/x(f)|^(0)|) < 
V{t,x) + R(t)forall{t,x)e'i)\+ x C°([-r, 0]; Dt"). 
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Then, system (1.10) is RFC from the input u e My, and there exists a function 
a e KL with a{s, 0) = ^ for all .v > such that for all (d, u) e Md x Mu and 
{to, xq) e S1{+ X C'^([-r, 0]; Sit"), the solution x(f) o/(1.10) with Tr(to)x — xq cor- 
responding to (d,u) e Md X Mu satisfies the following estimate for all t >tQ: 

V{t,Tr(t)x) 

<max{cr(fl(;S(fo)||jt:o||r),f-fo), sup cr(^(5(r)|M(r)|), f - t)| (4.202) 

Finally, 

1. If there exists a function ai of class K^c such that ai{\\H{t, x)\\y) < V(t, x) for 
all (t, x) e 9{+ X C°([-r, 0]; M"), then system (1.10) satisfies the WIOS property 
from the input u e My with gain y{s) :— aj~ {C,(s)) and weight S. Moreover, if 
in addition, /J(f) = 1, then system (1.10) satisfies the UWIOS property from the 
input u e Mu with gain y{s) := a^ (^(■s)) cind weight S. 

2. If H : Ot"*" X C ([—r, 0]; di") — > y is equivalent to the finite-dimensional contin- 
uous mapping h : [—r, +oo) x !1{" — >• ^P and there exist functions a\,a2 of class 
Koo such that ai{\h(t, x(0))\) < V(t,x), \\H(t,x)\\y < fl2(supggr_^o] l^'C^ + 
e,x(e))\)forall (t,x) e di+ X C°([-r,0]; di"), then system (1.10) satisfies the 
WIOS property from the input u e Mjj with gain yi^) '■— fl2(fli~ {^(s))) and 
weight 8. 

Proof of Theorem 4.4 We prove implications (a) =► (b), (b) => (c), (c) =^ (d), 
(d) =► (e), (e) =^ (a). The equivalence between (f) and (b) is a direct consequence 
of Theorem 4. 1 . 

(a) =► (b): Suppose that there exist functions a e KL, P,4> e K^ , and p e 
A'oo such that the estimate (4.186) holds for all {d,u) e Md x Mu, (fo,-«o) e 
m+ X C°([-r, 0]; at"), and t > to. If we set y(s) := a{p(s), 0), the desired (4.1) 
is a consequence of (4.186) and the previous definition. Thus statement (b) holds 
if (1.10) is RFC from the input u e Mu. If the hypothesis that (1.10) is RFC 
from the input u e Mu is not included in statement (a), then there exist func- 
tions a e Koo and fi, R e K'^ such that a(/x(f)|x(0)|) < \\H{t,x)\\y + Rit) for 
all (t, x) e S){+ X C°{[-r, 0]; St"). It follows from (4.186) and previous definitions 
that for all (to, xq) em+x C^i[-r, 0]; Sit") and (d, u)eMDxMu, the correspond- 
ing solution x(t) of (1.10) with Tr(to)x — xq satisfies the following estimate for all 
t>to: 

a{ix(t)\x(t)\)<Rit) + msL\\a{P(to)\\xo\\r,t-to), sup y (3(r)|M(T)|)} 

I to<r<t > 

The above estimate in conjunction with Definition 1.4 implies that (1.10) is RFC 
from the input u e Mu ■ 

(b) =► (c): By virtue of Corollary 4.1 and Hypothesis (S7), it follows that the 
system 

x(t) = f{t, Tr(t)x, v{t)d'(t), d(t)) Y(t) = H{t, Tr(t)x) (4.203) 

where A := Bu[0, 1] x D, H(t,x) := (H(t,x), ii{t)x) ey x C°([-r,0]; i)i"), and 
V e Mi)j+ satisfies the WIOS property from the input v e Mt)j+ . More specifically. 
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there exist functions fi, p,8 e K~^, a e KL, and y eJ\f such that (4.42) holds for the 
solutions of (4.203) for all v e M^^+, (to, xq, (d', d)) e m+ x C°([-r, 0]; d\") x Ma, 
and t > tQ. Without loss of generality we may assume that y e Koo- By virtue of 
Lemma 3.2 we obtain k e K^o such that y(rs) < K(r)K(s) for all (r, s) e (Dt"*")^. Let 
(pit) :— 8{t)K~^(r^), and let 9 e Koo be a locally Lipschitz function that satisfies 
9{s) < K~^(s) for all s >0. The previous definitions imply that 

^" "^ < y~H^^^\\x\\r] V(t,x)em+ xC°([-r,0];fl{") (4.204) 

4>it) - 8(1)'^ V 2 7 VL , J, y V 

Finally, the reader should notice that system (4.187) is the feedback interconnection 
of system (4.203) with the static map v(t) :— Iq-! ■ The result follows from 
Proposition 4.3 and inequality (4.204). 

(c) =► (d): Suppose that (4.187) is RGAOS. Theorem 3.6 implies that there exists 
a continuous mapping (t,x) e 9{"'" x C*'([— r, 0]; di") -^ V{t,x) e Dt"*", which is 
almost Lipschitz on bounded sets, with the following properties: 

- there exist functions a\,a2& Koo and p e K~^ such that 

ai{\\H(t,x)\\y + ix(t)\\x\\r)<V(t,x)<a2{P(t)\\x\\r) 

V(f , x) e m+ X C°{[-r, 0]; *){") (4.205) 

- it holds that 

V(r, x, d', d) e di+ X C°([-r, 0]; m") x A (4.206) 

Notice that inequality (4.206) implies the following inequality: 

V°{t, x; fit, X, u, d)) < -V(t, x) 

V(f,x,M,J)eS)t+ X C°([-r,0];S)r) xU x D with(Pit)\u\ <9{\\x\\r) (4.207) 

Using Property (PI) of Definition 2.4 for the continuous mapping (t, x) e SH"*" x 
C°([-r,0];i)r) -^ V{t,x) e 9{+, we obtain, for all {t,x,u,d) e 3t+ x 
C°([-r,0];9r) xU x D, 

I y°(f , x; fit, X, u, d)) - y°(f , x; f(t, x, 0, d)) \ 
<M{t+ \\x\\r + l)\f{t,x,u,d)- f(t,x,Q,d)\ 

The above inequality, together with (4.185), implies that the following inequality 
holds for all (f , x, u, d) e di+ x C°{[-r, 0]; di") x U x D: 

\V°{t,x; f(t,x,u,d)) - V°{t,x; f(t,x,0,d))\ 

<M{t+\\x\\r + l)Lu{t, ||x||^ + |m|)|m| (4.208) 



Define 



f{t,s) :— sup{M(z-+ IIjcII,. + \)Lu[t, \\x\\r + |m|)|m|; 

M\r<e-\Ht)s)Au\<s] (4.209) 
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Without loss of generality we may assume that the function <j) e K'^ is nondecreas- 
ing. Clearly, i/f : Sit"*" x i)}"*" -^ i)?"*" is a mapping with i/f (f, 0) = for all ? > 0, such 
that 

(i) for each fixed f > 0, the mapping i/r(f , ■) is nondecreasing; 
(ii) for each fixed s>Q, the mapping \l/(-,s) is nondecreasing; and 
(iii) limi^o+ V^(^ s) — for all t > 0. 

Hence, by employing Lemma 2.3 we obtain functions a^ e Koc and 8 e K'^ such 
that i/{t,s) <a3{S{t)s). 

We next establish inequality (4.189), with aj, as previously, by considering the 
following two cases: 

• 6~^((p(t)\u\) < \\x\\r. In this case inequality (4.189) is a direct consequence 
of (4.207). 

• 0~^i(t>it)\u\) > ||;c||,.. In this case, by virtue of inequalities (4.207), (4.208), defi- 
nition (4.209), and the definition of 03, we have 

y°(f , x; fit, X, u, d)) < y°(f , x; f{t, x, 0, d)) + f(t, \u\) 
<-V{t,x)+a3[8{t)\u\) 
which implies (4.189). 

(d) =► (e): Notice that (4.189) implies (4.191) with f (.?) := 2a^{s) and p{s) := 
)^s. The fact that system (1.10) is RFC follows directly from Theorem 4.6. 

(e) =► (a): Theorem 4.6 implies that system (1.10) is RFC from the input u e Mu 
and that (4.202) holds. Next, we distinguish the following cases: 

1. If (4.190) holds, then (4.186) is a direct consequence of (4.202) and (4.190). 

2. If (4.192) holds, then (4.202) implies the following estimate for all f > fo: 

\h{t,x{t))\<m2J^a-\a[a2{P{to)\\xo\\r),t-to)), 

sup a-\a{l;{8(s)\u(s)\),t-s)) 
to<s<t 

Since h : [—r, +00) x di" —>■ dV is continuous with h(t, 0) = for all t > —r, it 
follows from Lemma 2.3 that there exist functions p e Koc and </> e K^ such that 

\hit-r,x)\ < p{(t)it)\x\) V(r,x)eM+ X Sir 

Combining the two previous inequalities, we obtain, for all t >tQ, 

sup \h{t + 6,x(t + 6))\ 

e€[-r,0] 

<ma\lco[q(tQ)\\xo\\r,t — tQ^ sup co[^[S{s)\u{s)\),t — s) 

' to<s<t 

where g(f) :— /J(f) + max,<j-<r+f </>(t) cli(s, t) :— max{/7(i), aj" (a(s + a2{s),0))} 
for t e [0, r), and cti(s, t) :— max{exp(r — t)p(s), a^ ((7(s + aois), t — r))} for t > 
r. The above estimate, in conjunction with the fact that H : iH"*" x C^{[—r, 0]; 9t") — > 
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y is equivalent to the finite-dimensional mapping h, shows that (1.10) satisfies in- 
equality (4.186). 

The proof is complete. D 

Proof of Theorem 4.5 The proofs of implications (a) =^ (b), (d) =► (e), and (e) =► (a) 
follow the same methodology as in the proof of Theorem 4.4. Particularly, in the 
proof of implication (e) =>• (a), we use in addition the fact that since h : [—r, -|-oo) x 
Sli" -^ ?RP is continuous and T-periodic with h{t, 0) = for all t > —r, it follows 
from Lemma 2.4 that there exists a function p e Koc such that 

\hit-r,x)\ <p{\x\) V(f,x)ei)i+ xm" 

The proof of implication (c) => (d) differs from the corresponding proof in Theo- 
rem 4.4 in the definition of \[r. Specifically, we first notice that the fact that V is 
T-periodic implies that V'^(t,x; f(t,x,u,d)) is T-periodic. Using Property (PI) 
of Definition 2.4 for the continuous mapping (t,x) e SM"*" x C*'([— r, 0]; S)i") —s^ 
V(t, x) e S)t+, we obtain, for all (t, x, u, d)Gm+ x C°{[-r, 0]; m") x U x D, 

I V°{t, x; fit, X, u, d)) - y°(f , x; f(t, x, 0, d)) \ 

<M{T+\\x\\r + l)\f(t,x,u,d)- f{t,x,0,d)\ 

for certain nondecreasing function M : Sit"*" -^ di~^. The above inequality, in con- 
junction with (4.185) and the fact that / is T-periodic, implies that the following 
inequality holds for all (t, x, u, d) e m+ x C°([-/-, 0]; SH") x U x D: 

\V°{t,x; fit,x,u,d)) - V°{t,x; f(t,x,0,d))\ 
< M{T + \\x\\r + l)Lu{T, \\x\\,. + \u\)\u\ 
We next define 

f{s) := sup{M(r + ||x||, + \)Lu{T, \\x\\r + \u\)\u\; 

\\x\\r< R + a{e~^(s)), \u\ <s] 

Notice that Hypothesis (S8) implies that if(s) < a2,(s) for all s >Q, where 03(5) :— 
M(T + R+1+ a(e-\s)))Lv(J, R + a{d-\s)) + s)s, 7? > is the constant in- 
volved in Hypothesis (S8), a e Koo is the function involved in Hypothesis (S8) 
and M{s) is a continuous positive function which satisfies M{s) > M(s) for all 
s > 0. From this point the proof of implication (c) =► (d) is exactly the same 
as in Theorem 4.4 (i.e., by distinguishing the cases 0~'(|m|) < ||//(f,x)||j; and 

e-H\u\)>\\H(t,x)\\y). 

Finally, we continue with the proof of implication (b) =► (c). By virtue of Hy- 
pothesis (S7), it follows that the system 

iit)^ f{t,x(t),vit)d'(t),d(t)) Y{t)^H[t,x{t)) (4.210) 

where A :— Bc/[0, I] x D and i; e Mf)j+, satisfies the UIOS property from the in- 
put V e Mt)j+. More specifically, there exist functions a e KL and y e J\f such 
that (4.2) holds with yS(r) = 1 for the solutions of (4.210) for all v e M3i+, 
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(to,xo, (d',d)) e di+ X C°([-r,0]; !){") x M^, and t > Iq. Without loss of gen- 
erality we may assume that y e K^o- Let Q e K^o be a locally Lipschitz function 
that satisfies 0{s) < y~^(js) for all s >0. The previous definitions imply that 

e{\\H(t,x)\\y)<y-'(^\\H(t,x)\\y) V(f,x)e9{+xC°([-r,O];0t") (4.211) 

Finally, noticing that system (4.194) is the feedback interconnection of sys- 
tem (4.210) with the static map v{t) :— 6{\\H(t, Tr(t)x)\\y), the result follows from 
Proposition 4.4 and inequality (4.21 1). 

The proof is complete. D 

Proof of Theorem 4.6 Consider a solution of (1.10) under Hypotheses (Sl-7) cor- 
responding to arbitrary (u,d) e Mu x Md with initial condition Tf(tQ)x — xq e 
CH[-r, 0]; m"). By Lemma 2.17, for every T e (to, r^ax), the mapping [ro, T] 3 
t — ^ Vit, Tr{t)x) is absolutely continuous. It follows from (4.201) and Lemma 2.16 
that there exists a set / C [to, T] of zero Lebesgue measure such that the following 
implication holds for all t e [to, T]\I: 

V{t,Trit)x)>^{Sit)\u(t)\) ^ ^^{V{t,Trit)x))<-p{V{t,Trit)x)) 

Lemma 2.14 implies the existence of a continuous function a of class KL, with 
a(s,0) — s for all j' > such that 

V{t, Tr{t)x) < maxja(y(fo, r,(fo)x), t-to), 

sup a{^{S(s)\uis)\),t-s)\ Vfe[ro, r] (4.212) 

to<s<t ' 

with T e (to, fmax)- Notice that for the case where (1.10) is RFC from the input 
u e Mfj, /max = +00. For the case that there exist functions p e Koo and fx,, R e 
K+ such that p{fx(t)\x(0)\) < V{t, x) + R{t) for all (t, x) e m+ x C'^a-r, 0]; DT), 
combining the previous inequality and (4.212), we obtain, for every T e (to, ?max), 

p{fiit)\x(t)\) 

< R(t) + maxL{V {to, Tr(to)x), t-to), sup a{^{S(s)\u(s)\),t - s)] 

Vf e [ro, T] (4.213) 

It follows from estimate (4.213) that r^ax — +oo. An immediate consequence of 
Lemma 2.18 is that estimate (4.212) holds for all (ro, xo, d, u) e Dt+ x C°([-r, 0]; 
Slf ) X Md X Mu and r > /q. Moreover, if there exist functions p e Koo and p., R e 
K+ such that p(iJ.(t)\x(0)\) < V(t, x) + R{t) for all (r, x) e m+ x C°{[-r, 0]; M"), 
then Lemma 2.18 implies that (4.213) also holds for all (ro, xo, c?, m) e M"*" x 
C°([-r, 0]; or) X Md x Mu and t > to- In this case the fact that system (1.10) 
is RFC from the input u e Mu is a consequence of (4.213) and Definition 1.4. No- 
tice that (4.202) is a consequence of (4.212) and (4.200). Finally, (i) and (ii) are 
direct consequences of (4.202). The proof is complete. D 
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The following example presents an autonomous time-delay system which satis- 
fies the UWIOS property and does not satisfy the UIOS property. The analysis is 
performed with the help of Theorems 4.4 and 4.6. 

Example 4.7.2 Consider the following autonomous time-delay system: 
ii(r) — d{t)x\(t) 
xiit) — —X2(t) + xiit — r)uit) 
y(r)=X2(0 

{xiit),x2(t))' e m^, d{t) e D := [-1, 1], u{t) eU:^ m, Yit) e m (4.214) 
Consider the functional: 



y(f,xi,X2):=exp(-8f)xf(0) 



/o 
x^is)ds (4.215) 
-r 



1 , 1 

2-^1(0) +4 



First notice that the functional V : S)t+ x C°([-r, 0]; df) -^ !){+ defined by (4.215) 
is almost Lipschitz on bounded sets. Moreover, inequalities (4.190), (4.200) are 
satisfied for this functional with a(s) — a2{s) :— (1 + '^)s'^ + s^, a\ (s) :— ^s^, and 
fi{t) = 1 . We next estimate an upper bound for the Dini derivative of the functional 
y : 9i+ X C°([-r, 0]; m^) -^ !H+ along the solutions of system (4.214). We have, 
forall(r,x,M,J)eS){+ x C°i[-r,0];df) xdix [-1,1], 

y° (r, XI , X2; {dxi (0), -X2(0) + xi (-r)u)) 
= -8exp(-8r)x^(0) + 4c;exp(-8f)x^(0)-4exp(-4r)x^(0) 
+ 2Jexp(-40xf (0) - x|(0) + X2(0)xi (-r)u 



2exp(-8r) / x^is)ds + -exp{-8t)x1{0) - -exp(-8r)xf(-r) 

J—r 



4 " ' 1^ ' 4 



Using the inequalities \d\ < 1, X2(0)xi(— r)M < 5x|(0) + jxj(—r)u^, and 
5X^(— r)M^ < ^ exp(— 8?)x^(— r) + ^exp(8?)M'*, we are in a position to estimate, 
forall(r,x,M,J)e*){+ x C°([-r,0]; M^) x Mx [-1,1], 

y°(f,xi,X2; (fifxi(0),-X2(0) + xi(-r)M)) 

< -3exp(-8O^^(0) - 2exp(-4r)xf (0) - -xf (0) 



-I- -exp(80M'*-2exp(-8r) / x'l{s)ds 



1 

4 



Finally, using the above inequality and definition (4.215), we obtain, for all 

it,x,u,d)edi+ xC°([-r,0];S1{2)xi)ix [-1,1], 

y° (f , XI , X2; [dxi (0), -X2(0) + XI (-r)u)) 

<-y(r,xi,X2) + -exp(8f)M^ (4.216) 
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Inequality (4.216) guarantees that (4.191) and (4.201) hold with p{s) := \s, ^(s) := 
2*^, and S(t) :— exp(2r). Definition (4.215) guarantees that there exist functions 
p e Koo and fi e K+ and a constant R>{) such that p(/u.(?)k(0)|) < V{t,x) + 
R for all (r,x) e *){+ x CO([-r,0]; Wp-) (e.g., p(i) := ^i^ /x(f) := exp(-20, and 
7? := 0). It follows from Theorem 4.4 (statement (e)) that system (4.214) satisfies 
the UWIOS property from the input u e Mu . In order to be able to determine the 
gain and weight functions, we utilize the result of Theorem 4.6. Indeed, it follows 
from Theorem 4.6 that system (4.214) satisfies the UWIOS property from the input 
u e Mu with gain yis) :— ay{^{s)) — s^ and weight S{t) :— exp(2f). 

It should be emphasized that system (4.214) does not satisfy the UIOS property 
from the input u e My. This can be shown by considering the solution of (4.214) 
corresponding to inputs d(t) = 1 and u(t) = 1. It can be shown that, for xi (0) ^ 0, 
the output of (4.214) is not bounded and satisfies limf^+oo \Y(t)\ — +oo. Con- 
sequently, bounded inputs can produce unbounded outputs, which contradicts the 
requirements of the UIOS property from the input u e My . 



4.8 Bibliographical and Historical Notes 

1 . As remarked earlier, the ISS property was introduced for finite-dimensional sys- 
tems described by ODEs in [22]. It was quickly generalized to ISpS (input- 
to-state practical stability) and lOpS (input-to-output practical stability) in [8] 
for finite-dimensional systems described by ODEs. The work [27, 28] presents 
equivalent characterizations of lOS. The WIOS and WISS properties were intro- 
duced in [13, 14] for a wide class of systems and were based on the work centered 
around "nonuniform in time lOS" and "nonuniform in time ISS" in [10-12, 15, 
19]. As it is pointed out in [24], the lOS and ISS properties have been proved 
to be very useful in Mathematical Control Theory for a very important reason: it 
combines features of internal stability properties (Lyapunov stability looking at 
the effect of initial conditions for zero-input response) with features of external 
stability properties (input-output stability looking at the effect of nonzero inputs 
for zero-state response) proposed earlier in the literature; see the work of Zames, 
Willems, and others [24]. 

2. There is still another variation of the ISS property that was not examined in this 
chapter: the integral ISS (for short, iISS) property. This property was introduced 
in [23] for finite-dimensional systems described by ODEs and, roughly speaking, 
requires that there exist functions a e KL and y e Af such that the following 
estimate holds for all u e Mu, (fo, xq, d) e ;}i+ x Dt" x Mo, and t > Iq: 

\x(t)\<(T{\xo\,t-to)+ y{\u(r)\)dr (4.217) 

Jto 

where x(t) denotes the unique solution of (1.3) with initial condition x(fo) — xq 
corresponding to inputs (d, u) e Mu x Mjj . The iISS property cannot be easily 
generalized to other types of systems (notice that (4.217) implies that u e Mu 
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is Lebesgue integrable which holds for finite-dimensional systems described by 
ODEs but not necessarily for other systems). Using Lemma 2.3, we are in a 
position to find functions S e K~^ and y eAf such that exp(t)y(s) < y(S{t)s) for 
all t,s >0. Consequently, the integral on the right-hand side of (4.217) satisfies 

/ y(|M(T)|)iir= / exp(— r)exp(r)y(|M(T)|)iiT 

JtQ JtQ 

< I exp(— r)y ((5(r)|M(T)|) lit < sup j/(5(T)|M(r)|) 

Jto to<T<t 

Therefore, combining (4.217) with the above inequality, we easily obtain that 
if the iISS property holds, then the WISS property holds as well with weight 
S e K'^. The Lyapunov characterizations in Sect. 4. 7. A show that, if the ISS 
property holds, then the iISS property necessarily holds (see also [2, 23]). 

3. Various characterizations for the lOS and ISS properties for finite-dimensional 
systems described by ODEs were provided in [6, 25-28]. Among them, we 
should point out one characterization which was not given in the present chapter: 
the so-called "asymptotic gain" characterization. 

4. Another variation for the ISS property which is not studied in this book is the 
"local ISS property". See [9, 17]. 

5. For finite-dimensional discrete-time systems the ISS property was studied in [7]. 
In [7] one can find various characterizations of the ISS property for discrete-time 
finite-dimensional systems. 

6. For systems described by RFDEs, sufficient conditions for the ISS property were 
provided in [20, 29]. Necessary and sufficient conditions were presented in [16] 
(the results of Sect. 4.7.B are heavily based on the results in [16]). 

7. As remarked earlier, estimates of the form (4.1 14) ("fading memory estimates") 
were first used by Praly and Wang [21] for the formulation of exp-ISS and by 
Griine [3, 4] for the formulation of Input-to-State Dynamical Stability (ISDS) 
with H(t,x) — X and P(t) = y{t) = 1, which was proved to be qualitatively 
equivalent with (4.2) for finite-dimensional systems described by ODEs. It is 
clear that Theorem 4. 1 shows that for the WIOS property, the "fading memory" 
estimate (4.114) is qualitatively equivalent to the "Sontag-like" estimate (4.1). 
Applications of such "fading memory" estimates can be found in robust and 
adaptive nonlinear control; see Jiang and Praly (1998). 

8. Lemmas 4.3 and 4.4 should be compared with Lemma 1.1, p. 131, in [5]. The 
results of Sects. 4.4 and 4.6 of the present chapter are heavily based on (and 
slightly generalize) the results in [1 1, 13]. The invariance of the external stability 
properties to system transformations was discussed in [24]. 

9. Lyapunov-like characterizations for forward completeness of finite-dimensional 
systems described by ODEs were provided in [1]. It should be noted that certain 
results in [18] imply that forward completeness is RFC, and consequently, all 
characterizations given in Sect. 4. 7. A hold as well. 
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Chapter 5 

Advanced Stability Methods and Applications 



5.1 Introduction 

The present chapter is devoted to the description of advanced analysis methods for 
checking internal and external global stability properties introduced previously for 
various important classes of nonlinear dynamic systems. We will particularly focus 
attention on methods based upon 

• small-gain techniques and 

• vector Lyapunov functionals. 

The method of proving stability by means of vector Lyapunov functionals is an 
extension of the method of Lyapunov functionals described in previous chapters 
and has a long history. However, proving stability by means of small-gain results is 
a method radically different from all other methods of proving stability presented 
previously. The obtained small-gain results permit the derivation of novel vector 
Lyapunov characterizations of global stability notions. A special feature of small- 
gain results is the utilization of estimates of the solutions: these estimates must be 
proved by means of other methods (e.g., by means of Lyapunov methods or compar- 
ison principles or analytical solutions). Another important feature of the small-gain 
methods is that they can easily handle both static and dynamic uncertainties. In 
Chap. 6, we will see that small-gain techniques play a tremendous role in the design 
of nonlinear controllers with guaranteed robustness to static, parametric, input, and 
state dynamic uncertainties. 

An additional feature of the methods presented in this chapter is the capability 
of dealing with large-scale systems. Large-scale systems are encountered frequently 
in mathematical biology, engineering, and mathematical economics. Moreover, it is 
known that (generally) it is more difficult to establish global stability notions for 
large-scale systems than for systems described by a small number of (differential or 
difference) equations. The stability analysis methods presented in this chapter can 
exploit the structure of a given large-scale system in order to derive useful estimates 
for the solutions. 

Notice that sufficient conditions for global stability notions are developed in the 
system-theoretic framework described in Chap. 1 . 
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In what follows, U :— (X, y, Mjj, Mo, (p, n, H) will be a control system with 
the BIC property and for which e A" is a robust equilibrium point from the input 
M e Mu . Moreover, mq e My will be the identically zero input, i.e., mqCO = e t/ 
for all f > 0. For the output map H : i)}"*" x X x U ^ y, we assume that either 
H : Sit"*" X X X U -^ y is continuous or that there exists a partition it — {t,}^g of 
Sli"*" with diameter r > such that H : di'^ x X x U ^>- y satisfies Hypothesis (L2) 
in Sect. 1.7 of Chap. 1. 



5.2 The Small-Gain Theorem 

The main purpose of this section is to state and prove our main small-gain results. In 
order to develop the small-gain toolkit, we begin with certain notions of monotone 
operators. The background materials on the theory of monotone operators are first 
provided. 



5.2.1 Results on Monotone Operators 

The following technical definitions were used in [27] and are needed here. 

Definition 5.1 Let x = (jci , . . . , x„)' e m" and y = (yi , . . . , y,,)' e m" . We de- 
fine z — MAXjx, y], where z = (zi, . . . , z,,)' e S){" satisfies z; — maxjx,-, yi] for 
i — 1, ... ,11. Similarly, for ui ,..., u,n e ffi" , z — MAXJMi, . . . , m„,} is a vector 
z = (zi, . . . , ZnY e Si" with zt — max{Mi,, . . . , Umi}, i — 1, ...,n. 

Definition 5.2 We say that r ■.di"^.^ m"^ is MAX-preserving if F -.m"^^ m'\. is 
nondecreasing and for every x,y e 9i!j_, the following equality holds: 

r(MAX{x,y})=MAX{r(jc),r(y)} (5.1) 

The above defined MAX-preserving maps enjoy the following important prop- 
erty (see [27]). 

Proposition 5.1 F -.m"^^ 9t!j_ with r{x) = (A (x), . . . , r„(jc))' is MAX-preserv- 
ing if and only if there exist nondecreasing functions Yi,j ■ Si"*" — >• 9i'^ , i, j — 
1, . . . , n, with Fiix) — vaa\j-i „ yij{x j) for all x e S1{!j_, i — \, . . . ,n. 

Proof Define Yiji^) '■— I^iisej) for all s > 0, where {e(}f_j denotes the standard 
basis of W . Let x e 9i!J_, i.e., x — x\e\ + ■ ■ ■ + x„e„ with x; > 0, / = !,..., n. 
Notice that x — MAXjxiei, . . . , x„e„} and consequently r{x) — MAX{/^(xiei), 
. . . , r(x„e„)}. Therefore, Fiix) — max{r;(xiei), . . . , _r;(x„e„)} = 
maxy=i „ Yijixj). The converse statement is a direct consequence of the defi- 
nition Fi (x) = max/=i,...,„ yij (xj). D 
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The following class of MAX-preserving mappings plays an important role in 
what follows. 

Definition 5.3 Let r :di1^ di^ with r(x) ^(ri(x),..., r„(jc))' be a MAX- 
preserving mapping for which there exist functions yijeAfi,i,j — l,...,n, such 
that, for each i — 1,2, ... ,n, /l(x) = maxj=i ... „ yij(xj) for all x e JW!j_. We say 
that r : d\'!^_ —>■ d\"^_ satisfies the cyclic small-gain conditions if the following in- 
equalities hold: 

Yij (*) < * for all i' > 0, / = 1 , . . . , M (5.2) 

and if M > 1, then for each r = 2, . . . , m, it holds that 

(yi,,i2 ° YhJi ° ■ ■ ■ ° yirJi)(^) < ^ for all i' > (5.3) 

for all ij e {I, . . . , n], ij ^ ik if j ^ k. 

The following proposition provides useful characterizations for MAX-preserving 
mappings which satisfy the cyclic small-gain conditions. 

Proposition 5.2 Suppose that F ■.di']_^ dil with r(x) = (ri(jc), . . . , r„(jc))' is 
MAX-preserving and there exist functions yij € Mi, i, j — I, . . . ,n, with Fjix) — 
maXy^l ... „ Yijix j), i — I, . . . ,n. The following statements are equivalent: 

(i) lim^^oo r^^Hx) = Ofor all x e di^. 
(ii) r : di"^_ — > di"^_ satisfies the cyclic small-gain conditions. 
(iii) The following implication holds: r{x) >x^x — 0. 
(iv) (iii) holds, and for all k > I and x e di'^, it holds that r^^\x) < Q(x) — 

MAX{x, r(x), r(2)(jc), . . . , r("-')(jc)}. 

Proof We prove implications (iv) =► (i), (i) =► (iii), (iii) =► (ii), and (ii) =^ (iv). 
(iv) =► (i): Since F : d\"^_ -^ d\"^_ is MAX-preserving, we have 

r{Q(x)) = MAX{r(x), r(2)(jc), . . . , r^"Hx)} for all X e di^. 

Moreover, since r^'^\x) < Q(x) for all ^ > 1 and x e Df!j_, it follows that 
l^iQM) < Q(x) for all X e di"^_. Therefore, using induction, it follows that 
< r'-^+^HQix)) < r^^\Q{x)) for all fe > and x e m"^. It follows that the 
limit limj.^00 ^^^''^ (.Q{x)) exists and satisfies q := limj.^oo I^^'^^iQix)) > 0. The 
continuity of the mapping F : 'S\'\. -^ d\']_ shows that r(q) — q. By virtue of 
implication (iii) it follows that q — 0. Using the fact x < Q(x) for all x e d\"^_ 
(which implies < r^'^Hx) < T^'^^Qix)) for all /t > 1 and x e m'^), we obtain 
lim^^oo r'^'^Hx) = for all x e di^. 

(i) =^ (iii): The proof of implication (iii) is made by contradiction. Sup- 
pose that there exists x e d\"^_ with x 7^ such that F(x) > x. Using induction, 
we can show that r^'^\x) > x for all A: > 1. Consequently, we must have — 
limjt^oo /^**-'(x) > X, which contradicts the assumption x ^ 0. 
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(iii) =► (ii): If there exist s > and some integer ; — !,...,« such that 
Yiji^) ^ s^ then the nonzero vector x e [ft!]_ with x, — s and Xj — for j ^ / will 
violate (iii). Consequently, y, , (s) < s for all s > and i — I, . . . ,n. 

Next suppose that n > 1. Suppose that there exist some s > 0, r e {2, . . . ,n}, 
indices ij e {1, ...,«}, j = 1, ... , r, with ij ^ ik if j ^ k such that (y/,,,^ ° YhJ^ 
o ■ ■ ■ o >',,.,;,)(i) > i'. Without loss of generality we may assume that ij — j for 
j — I, . . . , r, and consequently (yi,2 o Yij o ■ ■ ■ o yr.i)is) > s. The nonzero vector 
X e ;H!j_ with XI — s, Xj — (yjj+i o Yj+i,j+2 o ■ ■ ■ o Yr.\){s) for j — 2, ..., r, and 
Xj — for i > r satisfies r{x) > x, and consequently hypothesis (iii) is violated. 
Therefore (ii) must hold. 

(ii) => (iv): The proof of this implication is a direct consequence of the fact that 

rl-'^Ux) = max{(y/,/, o yj^j^ o ■ ■ ■ o Kj,_,,./,)(j:/,) : (;i, . . . , jk) e {1, ■ • ■ , «}*} 

for all A: > 1, X e di"^_, and / — l,...,n. Using (ii), it can be shown that 
r'^"\x) < Qix) = MAX{x, Fix), r(2)(x), . . . , r("-^)(x)} for all x e di'l- Since 
r-.mi^ mi is MAX-preservlng, we have riQ(x)) = MAX{r(x), P'-^^x), ..., 
r("Hx)} for all X e m"^. As a result, we obtain r(Q(x)) < Q{x) for all x e di']_. 
By induction, it follows that r^'''>(.Q(x)) < Q{x) for all jfe > 1 and x e Ot^. Since 
X < Qix), we obtain r(*>(x) < Q{x) for alU > 1 and x e m"^. 

The fact that implication (iii) holds is shown by contradiction. Suppose that 
there exists a nonzero x e ST{!j_ with F(x) > x. Consequently, for every / e 
{1, . . . ,m}, there exists p(i) e {I, . . . ,n} with yi,p(i){xp(i)) > x/. With these inequal- 
ities in mind, there are at least one / e {!,...,«} with x,- > and a closed cycle 
(i, 71, ... , jr, i) such that iyij, o y/,,/, o ■ ■ ■ o y/,.,,)(x,) > x,-, which contradicts (ii). 
Therefore the implication (ii) =► (iv) holds. 

The proof is thus completed. D 

The following proposition provides a useful algebraic implication. 

Proposition 5.3 Suppose that T : Dfi!J_ ^ 9J'| with r(x) = (ri(x), . . . , r„(x))' is 
MAX-preserving and there exist functions ytj € A/i , i, j — I, . . . ,n, with -T)' (x) = 
maxy=i ... _„ Yijixj), i — I, . . . ,n. Moreover, suppose that F : S)i'^ — >• M!]. satisfies 
the cyclic small-gain conditions and that x < MAXja, r{x)}for certain x, a e 9i!|_. 
r/zen X < Qia), where Q{a) = MAX{a, r{a), r^'^\a), ..., r^"-^\a)}. 

Proof Suppose that x < MAX{a, r(x)}. Then r(x) < MAX{r(fl), P'-^Hx)} and 
X < MAX{a, Fia), F^^^x)}. By an induction argument, 

X <MAX{a, Fia), . . . , F'^''\a), F^''+^\x)} for alU > 1. 

It follows from statement (iv) of Proposition 5.2 that x < MAX{2(a), r^*+''(x)} 
for all ^ > 1. Since Hm<;^oo F^'^Hx) — 0, we obtain x < Q(a). D 

We end this paragraph by providing a list of useful facts that are consequences of 
the above definitions and propositions. The following facts will be used in the rest 
of the chapter. 
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Fact 1 If r : 9i']^ -^ 9i"^_ satisfies the cyclic small-gain conditions, then 
lim^^+oo r^^Hx) = for all x e 9t!|_, and F^'^Hx) < Q(x) for all k > I and 
X e mi- Recall that Q(x) = MAX{jc, r(x), r^'^\x), ..., r^"-^Hx)}. 

Fact 11 If r : S)i!j_ -^ ^'^ is a MAX-preserving mapping, then the mapping Q{-) is 
a MAX-preserving mapping. 

Fact III If r : S)t!j_ -^ Ot^ satisfies the cyclic small-gain conditions, then 
r{Q{x)) < Q(x) and Q(x) >x for all x e 3t^. 

Fact lY If p e J\fn and R : SH!j_ -^ S)t!]_ are nondecreasing mappings, then 
the following inequality holds for all s,r e Ot"*": p(MAX{R{\s), R{\r)}) — 
miix{p(R{\s)), p{R(\r))). 

Fact \ If r : 3t!j_ -^ Ot!j_ satisfies the cyclic small-gain conditions and x,y & '^\"^ 
satisfy x < MAX{y, r{x)}, then x < Qiy). 



5.2.2 Trajectory-Based Small-Gain Theorems 

We consider an abstract control system S :— {X, y, Mu, Md, </>, tt, H) with the 
BIC property for which e A" is a robust equilibrium point from the input u e 
Mu. We suppose that there exists a set- valued map 5)^+ 3 t ^ Sit) C X with e 
S(t) for all t > 0, mappings V,- : Ur>o{^} x -^(0 x {/ ^ S)t+ (/= 1, ...,«), L : 
U,>Q{{f } X S{t)} -^ di+ with L(t, 0) = 0, Vi (t, 0, 0) = for all f > (i = 1, . . . , «) 
and a MAX-preserving continuous map F : di"^_ —>■ di"^_ with 7^(0) = such that the 
following hypotheses hold: 

(SGI) (The "lOS-like" inequalities) There exist functions a e KL and ^ e A/i such 
that for every (to, xq, u, d) e Of"*" x A" x Mu x Md with (f>(t, to, xq, u, d) e 5(f) 
for all t e [fo.^max), the mappings t -^ V(t) — (Vi(r, (p(t, t(},xo, u,d), u(t)), ... , 
Vn{t,(l>(t,to,xo,u,d),u(t))y and t -^ L{t) — L(t,(j)(t,to,xo,u,d)) are locally 
bounded on [to, fmax) and the following estimates hold for all t e [to, fmax): 

V(t) <MAX{la(L(to),t - to), r([V][,,,,])n([Mu\^,^)} (5.4) 

where fmax is the maximal existence time of the transition map of S . 

(SG2) (Estimates during and after the transient period) For every (to,xo,u,d) € 
d\^ X X X Mu X Md, there exists § e 7T(to,xo,u,d) such that (j)(t,to,xo, 
u,d) e S(t) for all t e [§, Wx)- Moreover, there exist functions v,c,c e K~^, 
a, Y], ri, p",g'' eA/i,and/5 eJVn such that the following inequalities hold for every 
{to,xo,u,d) edi+x X X Mu x Md: 



208 5 Advanced Stability Metliods and Applications 

L(t) < max{v(t - to), cito),a{\\xo\\x), p{[V][^j]), p" {[Mu\,^^,])} 
forallf e[^,fmax] (5.5) 

\\4>(t,to,xo,u,d)\\.^ <max{v(t - to),c(to),a{\\xo\\x),ri{[\\u\\u]^^^^-^)} 
for all te[to,^] (5.6) 

^<to + a{\\xo\\x) + c(to) (5.7) 

\\H{t,(l)it,to,X(i,u,d),u(t))\\y<max{a{c(to)\\xo\\x),ri{[\\u\\u\^^,^)} 
for all t e [to, f] (5.8) 

L{^,(t)(^,to,xo,u,d))<mii\{a{c(tQ)\\xo\\x),g"{[\\u\\u\,^^^)}. (5.9) 

(SG3) (Bounds for the norm of the state and the norm of the output) There exist 
functions b e Mi, q, g e Nn, and jjl,k e K^ such that the following inequalities 
hold for all (t,x,u) e Ur>o{{'^} ^ ■^(0 x U}: 

Mt)\\x\\x<b{L(t,x) + g{V(t,x,u))+K(t)), (5.10) 

\\H(t,x,u)\\y<q{V(t,x,u)) (5.11) 

where V(t, x, u) — {V\{t,x, u), . . . , Vn(t,x, u))' . 

Discussion of Hypotheses (SGI), (SG2), (SG3) It is of interest to note that The- 
orem 5.1 is a new trajectory-based small-gain result for lOS because inequali- 
ties (5.4), (5.5) are not assumed to hold for all times. By combining Hypothe- 
ses (SGI) and (SG2) we can conclude that for each trajectory, there exists a time 
§ e 7T(to, xo, u, d) after which inequalities (5.4), (5.5) hold. On the other hand, in 
order to be able to conclude lOS for the system, we have to assume additional in- 
equalities which hold for the transient period t e [to, §], i.e., inequalities (5.6), (5.7), 
(5.8), (5.9) are required to hold. We next discuss each hypothesis in detail. 

• Hypothesis (SGI) is the hypothesis made in every small-gain result: it deals with 
the "lOS-like" inequalities, which are to be used and be combined, in order to 
prove the desired estimates. Notice that since we are using a family of n func- 
tional, the "lOS-like" inequalities are given for each functional separately: this is 
why (5.4) expresses n "lOS-like" inequalities (in vector notation). The difference 
between Hypothesis (SGI) and similar hypotheses involved in other small-gain 
results is that we do not assume that the "lOS-like" inequalities (5.4) hold for 
every initial condition and every input: instead, we assume that (5.4) holds only 
for those initial conditions and inputs for which the state (/)(f, to,xo,u,d) is in the 
set S(t) for all times t >to for which the state exists. 

• Hypothesis (SG2) is the key hypothesis that guarantees that the state will neces- 
sarily enter the set S(t). The time needed in order to enter the set S(t) is denoted 
by ^ e 7r(to, xq, u, d). Estimates (5.6), (5.8), (5.9) are estimates for the evolution 
of the state and the output during the transient period t e [fo, |], since during the 
transient period, the "lOS-like" inequalities (5.4) do not hold. Estimate (5.7) is 
an upper bound for the time needed in order to enter the set S(t): clearly, such 
an estimate is needed because we have to guarantee that the transient period (for 



5.2 The Small-Gain Theorem 209 

which the state can behave erratically) is not "too long." Finally, estimate (5.5) is 
a key estimate for the functional L : [J,>Q{{t} x S(t)} -^ Di"*" that appears in the 
right-hand side of inequalities (5.4). Inequality (5.5) holds for all times after the 
time needed in order to enter the set S(t) (after the transient). 

• Hypothesis (SG3) is a hypothesis made in every small-gain result (explicitly or 
implicitly): it provides the bound that allows us to guarantee that the state does not 
"blow up" and the bound that allows us to conclude that the norm of the output 
is related to the functional V, : Ur>o{{?} x Sit) x C/} ^ M+ (/ = 1, . . . , n). The 
reader should notice that for every small-gain result, such a hypothesis holds. 

• Finally, it should be noted that the set-valued map S(t) C A" is not assumed to 
be positively invariant. Instead, the state may enter and leave this set during the 
transient period t e [to,^]. However, after the initial transient period, the state 
never leaves the set S{t) C X. 

We are now ready to state the small-gain results. The first result provides suffi- 
cient conditions for the lOS property. 

Theorem 5.1 (Trajectory-based small-gain result for lOS) Consider a system 
U :— (X,y, Mu , Mo, 4>, TC, H) under the above hypotheses. Assume that the MAX- 
preserving continuous map P : 'iR'^ -^ y\"^ with 7^(0) = satisfies the cyclic small- 
gain conditions. Then the system E satisfies the lOS property from the input u e Mfj 
with gain y{s) :— viidi\{rj{s), q{G{s))}, where G(s) — {Gi(s), ... , G„{s))' is de- 
fined by: 

G(^)=e(lmax{a(/,"(.),0),a(g"(.),0),a(p(G(la(g"(5),0))),0), 

G{p{Q{ms))),0),t;(s)]) (5.12) 

with Q{x) = MAX{x, r{x), F^'^Hx), ..., r<«-"(x)} for all x e di^. Moreover, if 
c e A""*" is bounded, then the system E satisfies the UIOS property from the input 
u e Mfj with gain y(s) :— max{ri(s), q(G{s))}. 

When we seek to prove RGAOS for a given system, then some of the above 
hypotheses may be relaxed further. We consider an abstract control system S :— 
(X, y, Mu, Md, (p, n, H) with U = {0} and the BIC property for which Oe X 
is a robust equilibrium point from the input u e Mu. Suppose that there exists 
a set-valued map !1{+ 3 t -^ S{t) C X with e S(t) for all t > 0, mappings V,- : 
U>q{?} X S(t) -^ di+ {i^\,...,n),L: \J,^^{{t} x S{t)} -^ M+ with L{t, 0) = 0, 
Vi(t, 0) = for all f > (/ = 1, . . . , «), and a MAX-preserving continuous map 
r : at'l ^ iW'l with r(0) = such that the following hypotheses hold: 

(SG4) (The "lOS-like" inequalities) There exists a function a e KL such that for 

every {tQ,xo, d) e SH+ x X x Md with(/>(r, tQ,XQ,U(),d) e S(t) for all f e [?o, ?max). 
the mappings t -^ V(t) — (Vi(t, (p(t, fo,xo, UQ,d)), ... , Vn{t,4'{t, tQ,XQ,uo,d)))' 
and t —>■ L(t) — L(t, (j)(t, to, xq, uq, d)) are locally bounded on [to, fmax) and the 
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following estimate holds: 

V(t)<MAX{lcT{L{to),t-to),r{[V][t,j])} Vre[fo,fmax) (5.13) 

where fmax is the maximal existence time of the transition map of S . 

(SG5) (Estimates during and after the transient period) For every {to, xo,d) e i)}"*" x 
X X M[), there exists § e 7r(fo, xq, uq, d) such that (p{t, to, xq, mq. d) ^ S(t) for all 
t €[$, fmax)- Moreover, there exist functions v,c e K'^, a eJ\fi, and p eJ\f„, such 
that for every (Iq, xq, d) e Di"*" x ^ x Mu, the following inequalities hold: 

L{t) < max{v(f - fo), c{to),a{\\xo\\x), p{[V][^j])} Vr e [^, Wx) (5.14) 
\\(t>(t, to,xo,UQ,d)\\^ 

<max{i;(f-fo),c(fo),a(||xo||A')} Vfe[fo,t] (5.15) 

^<to + a{\\xo\\x)+c(to) (5.16) 

L(^)<a{\\xo\\x)+c(to). (5.17) 

Discussion of Hypothesis (SG5) Hypothesis (SG5) is almost the same with Hy- 
pothesis (SG2) applied to the case U — {0}. Nonetheless, notice the difference that 
the estimate for L(^) in inequality (5.17) is less tight than the estimate needed in 
inequality (5.9) of Hypothesis (SG2). Indeed, when xq — 0, estimate (5.17) does 
not yield L{^) — 0, contrary to the estimate (5.9), which gives L(^) — 0. Finally, 
the analogue of inequality (5.8) for U — {0} (estimation of the norm of the output 
during the transient period) is not needed in Hypothesis (SG5). 

Theorem 5.2 (Trajectory-based small-gain for Robust Global Asymptotic Out- 
put Stability (RGAOS)) Consider a system E :— {X, y, Mjj, Md,(P, tt, H) with 
U — {0} under Hypotheses (SG3), (SG4), (SG5). Assume that the MAX-preserving 
continuous map F : 9t"^_ — >• !){!|_ with r(0) — satisfies the cyclic small-gain condi- 
tions. Then the system E is RGAOS. Moreover, if S :— {X , y. My , Md, (p, n, H) is 
T -periodic for some T > 0, then the system S is Uniformly RGAOS (URGAOS). 

It is clear that Hypotheses (SG4), (SG5) are less demanding than Hypothe- 
ses (SGI), (SG2). On the other hand, the conclusion of Theorem 5.2 is weaker 
than the conclusion of Theorem 5.1: Theorem 5.2 only guarantees RGAOS, while 
Theorem 5.1 guarantees lOS. 

Proof of Theorem 5.1 The proof consists of four steps: 

Step T. We show that for every {tQ,xo,u,d) e di~^ x A" x My x Mq, the following 
inequality holds for all f e [f, Wx): 

V(t) <MAX{Q{la{Li^),0)), Q{n{[\\u\\u\^ ^^))} (5.18) 

where f e 7r(to, xq, u, d) is the time such that 0(r, fo, -'^o, u, d) e S{t) for all t e 
[?, ?max) (recall Hypothesis (SG2)). 



5.2 The Small-Gain Theorem 211 

Proof of Step 1: Let (tQ,xo,u,d) e Dt"*" x X x My x Mj). By virtue of Hypothesis 
(SG2), there exists ^ e yt{to, xq, u, d) such that (/>(f , ro, xq, u, d) e S(t) for all t e 
[?, ?max)- Inequality (5.4) impHes, for all t e [^, Wx), 

[V][^j]<MAX{la{L(^),0),r{[V][^j]),l^{[Mu\^^^)} (5.19) 

Fact V in conjunction with (5.19) implies (5.18) for all t e [|, fmax)- 

Step 2: We show that for every (to, xq, u, d) e di~^ x X x My x Md, it holds that 

fmax = +00- 

Proof of Step 2: Suppose that f^ax < +oo. Then by virtue of the BIC property 
for every M > 0, there exists t e [to, fmax) with \\4>{t, to, xq, u, d)\\x > M. On the 
other hand, estimate (5.18), in conjunction with the hypothesis fjuax < +oo, shows 
that there exists Mi > such that supj<^<f_^^^^ \V(r)\ < Mi. The fact that V{t) is 
bounded for t e [^, ?rnax), in conjunction with estimate (5.5), implies that there ex- 
ists M2 > such that supj<^<,_^^^ L(t) < M2. It follows from (5.6), (5.10) that 
the transition map of S, i.e., (j)(t,to,xo,u,d), is bounded on [fo> Wx), and this 
contradicts the requirement that for every M > 0, there exists t e [to, ?max) with 
\\(p(t, to, xo, u,d)\\x > M. Hence, we must have fmax = +00. 

Step 3: We show that U is RFC from the input u e My. 

Proof of Step 3: Let arbitrary r > 0, 7 > and arbitrary u e M{Bu[0, r]) n 
Mu, \\xq\\x <r,to& [Q,T],d e Md be given. Estimate (5.6) shows that there 
exists M :— M(r, T) > such that sup, <j.<t \\4>(r,to,xo,u,d)\\x < M < +00. 
This provides an upper bound for sup{||(/)(fo + s, to,xo, u,d)\\x', s e [0, T]} when 
fo + r < f . We next assume that to + T > ^.By (5.9) there exists M := M{r, T) > 
such that L(f) < M < +00. Estimate (5.18) shows that there exists Mi :— 
Mi{r, T) >0 such that supt<^<, _|_7- 1 V(t)| < Mi < +00. Consequently, estimate 
(5.5) implies that there exists M2 :— M2(r, T) >0 such that supt<^<, _|_7- L(t) < 
M2 < +00. It follows from (5.10) that there exists M3 :— Mi,(r, T)>0 such that 
^"Pf<T</o+r H(T:,to,xo,u,d)\\x < M3 < +00. Hence, 

sup{\\4>{tQ + s , to, xo, u, d)\\ ^•, u eM[Bu[Q,r]) nMu,s e [0, T], \\xo\\x <r, 
toe[id,T],deMD] < +00 
Therefore, we conclude that S is RFC from the input u e Mu . 

Step 4: We prove the following claim. 

Claim For all s > 0, k e Z"*", and R,T >0, there exists tkis, R,T) >0 such that 
for every {to, xq, u, d) e Dt"*" x X x Mu x Mo with to e [0, T} and \\xo\\x < R7 the 
following inequality holds for all t > ^ + Xk'. 

V(t) <MAX{Q{ls), r^'\Q{la{L(^),0))),G{[\\u\\u\^^ ,^)} (5.20) 
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where G is defined by (5.12). Moreover, if c e K'^ is bounded, then for all e > 0, 
k e Z"*", and R > 0, there exists tide, R) > such that for every (to,xo, u,d) € 
Dt"*" y. X y. Mjj x Md with \\xq\\x < R, inequality (5.20) holds. 

Proof of Step 4: The proof of the claim will be made by induction on A: e Z"*". 

First, we show inequality (5.20) fox k— 1. 

Let arbitrary e > Q, R,T >0, and {to, xq, u, d) e^\'^ x X x Mu x Md with 
fo e [0, r] and IIxoHa" < /? be given. Inequality (5.4), in conjunction with inequal- 
ity (5.18), gives, for all r > §, 

y(O<MAX{la(L(?),r-^),r(G(la(L(§),0))), 

r[Q{H{[M\u\,;})),H{[M\u\.n)] (5.2i) 

Since r{Q{x)) < Q{x) and Q{x) > x for all x e 3{!|_ (see Fact III), inequality (5.21) 
implies, for all r > §, 

y(0 < MAX{1ct(L(§), f - t), r(e(la(L(^), O))), e(l^([ll«M[5,,]))} (5.22) 

Inequality (5.22), in conjunction with (5.9), implies, for all r > |, 

y(0<MAX{la(fl(c(fo)||xo||A'),f-t),l^(g"([l|MM[,„_^]),0), 

r(G(la(L(^),0))), Q[H{{\\u\\u\,^))] (5.23) 

Finally, inequality (5.23), in conjunction with the fact that Q{x) > x for all x e 9{!j_ 
and definition (5.12), implies the following estimate for all f > f : 

V(t) <MAX{la{a{c(to)\\xo\\x),t - ^), r{Q{la{L(^),0))),G{[Mu\^^^)} 

(5.24) 

Using the properties of the KL functions, we can guarantee that there exists 
ri(e, R,T) >0 such that cr(a(^maxo<f<r c(f)), ti) < e. Notice that if c e K~^ is 
bounded, then ri > is independent of T. Then, it follows from (5.24) that we have 
V{t) < MAX{le, r(e(la(L(t),0))), Qm{[\W(r)\\uhoJ]m for all f > f + n. 
Since Q(le) > le, we conclude that inequality (5.20) holds for ^ = 1. 

Inequality (5.5), in conjunction with inequality (5.18) and Fact IV, gives, for all 

Lit) < max{v(r - fo), c(fo),«(||xo||A^), p{Q{\a{L{^), O))), 

p{Q{H{[\\u\\u\^^,;})),p''{[\\u\\u\J] (5.25) 

Next, suppose that for all e > and R,T >0, there exists rids, R,T) >0 such that 
for every (fo, xq, u, d) e^)^'^ x X x Mu x Md with to e [0, T] and \\xq\\x < R, 
(5.20) holds for some k e Z"*". Let arbitrary s > 0, R,T >0, and (fo, xq, u, d) e 
9{+ X A" X Mu X Mo with fo e [0, T] and \\xo\\x < R he given. Notice that the 
weak semigroup property implies that 7r(fo, xq, u, d) (1 [^ + r^ , ^ + tk + r] ^ 0. Let 
tk e 7T(fo, xo,u,d) n[^ + tic,^ + rk + r]. Then (5.4) implies that, for all f > tk, 

V(t) < MAX{la(L(f,), f - tk), /^([V][r,,/]), lC([ll«llw][,,,,])} (5.26) 
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Moreover, inequality (5.20) gives, for all t >tk, 

[V]ta,,]<MAX{e(le),r«(e(la(L(^),0))),G([||M||w]^,^_,j)} (5.27) 
Inequality (5.25) also implies 

Litk) < max{v(tk - to), c(fo), a(R), p{Q{la{L{^), O))), 

p{Q{Hi[Mu\,^J)),p"{[Mul^J} (5.28) 

Using (5.9) and (5.28), we obtain 

L(tk) <max{v(tk - to), c(to), a(R), p{Q{la{a{c(to)R),0))), 

P"i[Mu]y,J} (5.29) 

Using (5.27) and the fact that r{G(s)) < G{s) for all s>0,we obtain 

r([y]te,r])<MAX{G(le),r('^+i)(e(la(L(§),0))),G([||M||i,]^^^^j)} 

for all t > tk (5.30) 

Inequality (5.30), in conjunction with inequality (5.26), the fact that G{s) > 
QiHis)) > His) for all .? > 0, and the fact that tk <^ + rk+r, implies 

V(t) < MAX{la{L(tk), t-^-tk-r), Q(ls), r'^''+'\Q{la{L(^), O))), 

'5([ll«M[ro,n)} foi-allf>t + r, + r (5.31) 

Inequality (5.29), in conjunction with (5.7) and the facts that la(p''(s), 0) < G{s), 
lcT(p{Qm{s))), 0) < G{s), and la{p{Q(la(g"(s), 0))), 0) < G(s) for all .? > 
(see definition (5.12)) and tk < ^ + tk + r , to & [0, T], and ||xo||;\:' < R, implies that 

la{L(tk),t-^-rk-r) 

< MAX{la(/(£, T,R),t-^-rk-r), G{[Mu\^^,^)} 

for all f > f + TA- + r (5.32) 



where 



and 



f (e, r, /?) := max! max v{t),C(T),a(R), 

[Q<t<a(R)+C(T)+Zk(E,R,T)+r 

p{Q{la{a{RC(T)),0)))} (5.33) 



C(T) := max c(t) (5.34) 

0<r<r 



Notice that if c e K'^ is bounded and tk is independent of T, then / can be chosen 
to be independent of T as well. By combining (5.31) and (5.32) we get 

V{t) < MAX{la(/(£, T,R),t-H- r, - r), r^''+'\Q{lG{L(^), O))), 

e(le),G([||«|b]j^^,j)} foralU>§ + ri+r (5.35) 
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Clearly, there exists r(e, R,T) >0 such that (j{f{s, T, R), r) < e. Define 

Tk+iis, R, T) = This, R,T) + r + r(£, R, T) (5.36) 

Again, notice that if / and r^- are independent of T, then ri:-|_i is independent of T 
as well. Since Q(ls) > Is, we obtain from (5.35) 

V{t)<MAX{Q(ls),r'-'+'\Q{la{L(^),0))),G{[Mu\^,^)} 
for all f > ^ + n+i (5.37) 

which shows that (5.20) holds for A: + 1. 

To finish the proof, 1st s > 0, R,T >Q, and (fo, xq, m, li) e S1{+ x A" x Mu x Mq 
be arbitrary and denote Y(t) — H(t, ^(t, to, xq, u, d), u(t)) for t > fo- 

Using Fact IV, (5.11), and (5.18), we obtain, for all t > f , 

\\Yit)\\y<max{q{Q{la{L(^),0))),q{Q{m[\\u\\u\^,-^)))} 
The above inequality, in conjunction with (5.9), implies that 

||y(0||y<max{g(G(la(a(c(fo)lko||A'),0))),^(G(lr([||M||w]j,^,j))), 

q{Q{la{g''{[Mu\^^^),0)))} forallr>§ (5.38) 

Using (5.8) and (5.38), we conclude that the following estimate holds for all t > to: 

\\Yit)\\y<ma\{q{Q{la{a{cito)\\xo\\x),0))),a{cito)\\xo\\x), 

?(G(l?([ll«lb][,„,])))} (5.39) 

Inequality (5.39) shows that Properties PI and P2 of Lemma 4. 1 hold for system S 
with V — \\H{t, X, u)\\y, S(t) = 1, and y(.j) :— nistx{ri{s), q(G{s))}. Moreover, if 
c e A"*" isbounded, then (5.39) implies that Properties PI and P2 of Lemma 4.2 hold 
for system S with V — \\H(t, x, u)\\y, S(t) = 1, and y(s) := max{ri(s), q{G(s))}. 
Inequality (5.20), in conjunction with Fact III, (5.9), (5.34), and definition (5.12), 
guarantees that for all e > 0,k e Z"*", and R,T > 0, there exists ztis, R,T) >0 such 
that for every (to,xo, u,d) edl'^ x X x Mu x Md withfo e [0, T] and \\xo\\x < R^ 
the following inequality holds: 

V(t) <MAX{Q{ls), r^'^Q{la{a{RC(T)),0))), G{[Mu\^^ ,^)} 
forallr>t + ri. (5.40) 

Notice that Fact I guarantees the existence of k(s, T, R) e Z+ such that Q(ls) > 
r'''HQ{la(a{RC(T)),0))) for all I > k. If c e K+ is bounded, then k is inde- 
pendent of T. Therefore, (5.40) implies that for all e > and R,T >0, there ex- 
ists T(e, R,T) >0 such that for every (fo, xo, u, d) e iW*" x A" x Mjj x Mu with 
to e [0, T] and \\xo\\x < R, it holds that 

Vit)<MAX{Q(ls),G{[Mu\^,^)} forallf>t + r (5.41) 

If c e K'^ is bounded, then r{s, R,T) > is independent of T. It follows from 
inequalities (5.11), (5.41), definition (5.12), and Fact IV that for every e > and 
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R,T >0, there exists r(e, R,T) >0 such that for every {to, xq, u, d) e di~^ x X x 
Mu X Md with to e [0, T] and ||xo|| a- < R, it holds that 

\\Y(t)\\y<m?.x{q{Q{\s)),q{G{[\\u\\u\^,^))] for alH > § + r (5.42) 

Therefore, by virtue of (5.42) and (5.7), Property P3 of Lemma 4.1 holds for 
system U with V — \\H{t,x,u)\\y, S(t) = 1, and y(s) :— xnax{ri{s), q(G{s))}. 
Moreover, if c e K~^ is bounded, then (5.42) and (5.7) imply that Property P3 of 
Lemma 4.2 in Chap. 4 hold for system S with V — \\H(t,x,u)\\y, S(t) = 1 and 
y(s) := ma\{r]{s), q(G{s))}. 

The conclusions of Theorem 5.1 are direct consequences of Lemma 4.1 (or 
Lemma 4.2 for the case of bounded c e K'^). D 

Proof of Theorem 5.2 By virtue of Lemma 2.1 we have to show that S is Robustly 
Forward Complete (RFC) and satisfies the Robust Output Attractivity Property, i.e., 
for every e > 0, T > 0, and R>Q, there exists r :— r(e, T, R) >0 such that 

\\xo\\x<R toe[0,T] ^ \\H{t,(t>(t,to,xo,UQ,d),0)\\y<e 

for all t e[to + r, +00) and all d e Mo- Moreover, Lemma 2.2 guarantees that the 
system S — {X, y, Mu,Md,(P, tt, H) is URGAOS if it is T-periodic for certain 

r>o. 

The proof consists of four steps: 

Step 1: We show that for every (ro, XQ,d) e d\~^ x X x Md, the following inequality 
holds for all t e[^, tmax)'- 

V(r)<e(la(L(t),0)) (5.43) 

where f e 7t(to, xq, uq, d) is the time such that </>(?, to, xq, uq, d) e S(t) for all t e 
[?, ?max) (recall Hypothesis (SG5)). 

Proof of Step 1: Exactly the same as in Theorem 5.1. 

Step 2: We show that for every (to, xq, d) e Dt"*" x X x Mo, it holds that fmax — +00. 

Proof of Step 2: Exactly the same as in Theorem 5.1. 

Step 3: We show that S is RFC. 

Proof of Step 3: Exactly the same as in Theorem 5.1. 

Step 4: We prove the following claim. 

Claim For all s > 0, k e Z"*", and R,T >0, there exists Xk(e, R,T) >0 such that 
for every (to, xq, d) € S)}"*" x X x Md with to e [0, 7"] and \\xo\\x < R^ the following 
inequality holds: 

V(t)<MAX{Qils),r^''\Q{la{L(^),0)))} forallt>^ + Xk (5.44) 
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Proof of Step 4: The proof of the claim will be made by induction on A: e Z"*". 

First we show inequality (5.44) for k—l. 

Let arbitrary e>Q, R,T >{), and (fo, xq, cf) e S){+ x A" x Md with t^ e [0, T] 
and IIxoIIa' < R he given. Inequality (5.13), in conjunction with inequality (5.43), 
gives, for all f > ^, 

V(t) < MAX{la(L(§), t - §), r(e(la(L(?), O)))} (5.45) 

Inequality (5.45), in conjunction with (5.17), implies, for all t >^, 

V{t) < MAX{la(fl(||xo||;t) + c(fo), f - f), r{Q{la{L(^), O)))} (5.46) 

Using the properties of the KL functions, we can guarantee that there exists 
ri(e, R,T) >0 such that a(a{R) + maxo<r<r c(t), ri) < e. Since Q{ls) > Is, we 
conclude that inequality (5.44) holds for A: = 1. 

Inequality (5.14), in conjunction with inequality (5.43) and Fact IV, gives, for all 

L{t) < max{y(f - fo), c(to),a{\\xo\\x), p{Q{1(t{L(^), O)))} (5.47) 

Next, suppose that for all e > and R,T >0, there exists rk(s, R,T) >0 such that 
for every (to, xq, d) e !H+ x A" x Mq with t^ e [0, T] and ||xo||^ < R, (5.44) holds 
for some A: e Z+. Let arbitrary e > 0, R,T >0, and {to, xo,d) e Dt"*" x X x Mb 
with fo e [0, r] and 11x011;^ S R be given. Notice that the weak semigroup prop- 
erty implies that 7t(to, xo, u,d)r\[^ + Xk,^ + tk + r}^&. Let tk e TT(to, xo, u, d) fl 
[^ + rj., § + rj. + r]. Then (5.13) implies 

V{t)<MAX{\G{L{tk),t-tk),r{[V\„,t})] Wt>tk (5.48) 

Moreover, inequality (5.44) gives 

[V]te,r]<MAX{e(le),r«(e(la(L(§),0)))} Vf > f^ (5.49) 

Inequality (5.47) also implies: 

L(tk) < max{v(tk - to), c(fo), a(R), p{Q{1ct{L(^), O)))} (5.50) 

Using (5.17) and (5.50), we obtain 

L{tk) < max{v{tk - to), c{to), a(R), p{Q{la(a{R) + c(fo), O)))} (5.51) 

Using (5.49) and the fact that r{Q(x)) < Q(x) for all x e DJ';, it holds 

r{[V][r,,r])<MAX{Qils),r^''+''>{Q{la{L(^),0)))} Vt>tt (5.52) 

Inequality (5.52), in conjunction with inequality (5.48) and the fact that tk < ^ + 
Xk+r, implies 

V(t) < MAX{la(L(r,), t-^-Xk-r), Q{le), r^''+'\Q{la{L{^), O)))} 
for a\\t>^ + Xk+r (5.53) 

Inequality (5.51), in conjunction with (5.16) and the facts that tk < ^ + x^ + r, 
to e [0, r], and ||xo|| a' < R, implies that, for all r > § + r*: + r, 

a{L{tk), t-^-Xk-r) <a{fis, T,R),t-^-Xk- r) (5.54) 
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where 

/(£, r, /?) := max! max vit),CiT),a(R), 

yO<t<a(R)+C(T)+Tk(E,R,T)+r 

p{Q{la{a(R) + C(T),0)))j (5.55) 



and 



C(T) := max c{t) (5.56) 

0<r<r 



Combining (5.53) and (5.54) leads to 

V(t) < MAX{la(/(e, T, R),t - ^ - n - r), Q(le), r^''+'\Q{la{L(^), O)))} 
for all f > t + Ti + r (5.57) 

Clearly, there exists r(s, R,T) >0 such that a{f(E, T, R), r) < s. Define 

rk+\(e, R, T) = Xk{s, R,T) + r + r(e, R, T) (5.58) 

Since Q(le) > Is, it follows from (5.57) that 

V{t)<MAX{Q(ls),r^''+'\Q{la{L(^),0)))} Vf > ^ + r^+i (5.59) 

which shows that (5.44) holds for ^ + 1. 

To finish the proof, let e > 0, R,T >0, and {to, xo,d) em+ x X x Md be 
arbitrary and denote Y(t) — Hit, (pit, to, xo, uo, d), 0) for t > fo- 

Inequality (5.44), in conjunction with Fact III, (5.17), and (5.56), guarantees that 
for all e > 0, A: e Z+, and /?, r > 0, there exists Xkie, R,T)>0 such that, for 
every ito,xo,d) e di~^ x X x Mo with to e [0, T] and ||xo||;f < R, the following 
inequality holds: 

y(f)<MAX{e(l£),r«(e(la(a(iJ) + C(r),0)))} V?>f + ri (5.60) 

Notice that Fact I guarantees the existence of kis, T, R) e Z"*" such that Q(le) > 
r'''\QilaiaiR) + C(r),0))) for all / > k. Therefore, (5.60) implies that for all 
e > 0, and R,T >0, there exists T(e, R,T) >0 such that for every (fo, xq, d) e 
9{+ X A" X Md with to e [0, T] and ||xo||a' < R, it holds that 

Vit)<Qil8) forallf>t + r (5.61) 

It follows from inequalities (5.11) and (5.61) that for all e > and R,T >0, there 
exists r(e, R,T)>0 such that for every (fo, xo, d) e M+ xX x Md with to e [0, T] 
and IIxoIIa" < R, it holds that 

\\Yit)\\y<q{Qils)) forallr>^ + r (5.62) 

Therefore, by virtue of (5.62) and (5.16), the Robust Output Attractivity Property 
holds for system E . The proof is complete. D 

The small-gain conditions (5.3) for « = 2 are equivalent to the inequalities 
Y\,2{Y2,\is)) <s and Y2.i[Y\,2is)) < s for all i > 
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However, it should be noted that the second inequaUty above is implied by the first 
one. For n — 3, conditions (5.3) are equivalent to the following twelve inequalities 
for all s >0: 



/1,2(K2,i(^)) <S 


K2,l(yi,2(^)) <S 




yi,3(K3,l(^)) <S 


K3,l(n,3('j)) <'5 




72,3 (K3, 2 (^)) <S 


73,2(72,3 (■j)) <'^ 




Kl,2(y2,3(K3,l(^))) 


<s 73,1(71,2(72,3(5))) < 5, 


72,3(73,1(71,2(5))) <s 


K2,i(k1,3(K3,2CO)) 


<5 7l,3(73,2(72,l('0)) <5 


73,2(72,1(71,3(5))) <s 



Also notice that some of the above inequalities are equivalent. The following 
five inequalities 

71,2(72,1(5)) < 5 71,3(73,1(5)) < 5X2,3 (73,2(5)) <5 

71,2(72,3(73,1(5))) < 5 and 72,1(71,3(73,2(5))) < 5 foralli'>0 

imply all twelve inequalities that express conditions (5.3) in this case. 

Finally, it should be noticed that if the norm of the input \\u\\u appears in in- 
equalities (5.4)-(5.9) "weighted" by certain S e K'^, i.e., if [||M||j^][ro,f] is replaced 
by supf^^^f S(r)\\u(r)\\n, then the result of Theorem 5.1 will guarantee WIOS 
with weight function S e K~^, instead of lOS. 



5.3 Vector Lyapunov Functionals 

In this section, we will restrict our attention to the problem of the verification of 
the assumptions of the small-gain results of the previous paragraph (Theorems 5.1 
and 5.2) by means of Lyapunov functionals. The obtained results are termed as 
results involving "vector Lyapunov functionals" due to the fact that a family of 
Lyapunov functionals is used. 



5.5.7 Vector Lyapunov Functions for Systems Described by ODEs 

Consider systems described by Ordinary Differential Equations (ODEs) of the 
form (1.3) under Hypotheses (Hl-5). Moreover, we assume that the output map 
H is independent of m e C/. Finally, we will assume that 

(SG6) There exist functions V,- e C\m+ x SH"; *){+) {i ^l, . . . ,k),W e C\m+ x 
9i"; ;H+), fli,fl2:«3:«4 e .^00 IJ',P,K e K+, ^ eM\, g eMk,Yij e M, Pi e M, 
i,j — \,...,k, a family of positive definite functions p, e C*'(9t"'"; Dt"*") (/ — 
\, . . . ,k), and a constant k e (0, 1) such that the following inequalities hold for 
all(f,x,M)e!H+ x !H" x U: 
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ai(\Hit,x)\)< max V,(f,x) < azfySCOkl) (5.63) 

i = l....,k 

a3{fi(t)\x\) - g{Viit,x), ..., Vk(t, x)) - Kit) < Wit,x) < a4{pit)\x\) (5.64) 
sup 

<-W(t,x)+Xmax\^{\u\), max pj{Vj(t,x))] (5.65) 



dW dW 

(t,x)-\ {t,x)f(t,x,u,d) -.deD 

dt dx 



and, for all / = 1, . . . , ^ and (t, x, u) e Dt"*" x ilt" x U, the following implication 
holds: 



"if maxK(|M|), max y/,/(V,(f,x)) ! < V,(r,x), 



then (t,x)+ sup {t,x)f{t,x,u,d) < -p,( y/(r, x))" (5.66) 

dt d^D ox 

Our main result concerning systems of the form (1.3) is the following result, 
which provides sufficient conditions for Theorem 5.1 to hold. 

Theorem 5.3 (Vector Lyapunov function characterization of the lOS property) 
Consider system (1.3) under Hypotheses (Hl-5) and (SG6). Moreover, we assume 
that the output map H is independent of u e U . If the small-gain conditions (5.3) 
hold, then system (1.3) satisfies the 10 S property with gain y — a^ o 6 e Afi from 
the input u € Mj/ , where 

6(s):— max (^/(max! max max YijiVji^i^)))' 

max pi{ipi{^(s))),^(s)\) (5.67) 

and 

(Pi(s) := maxji, max max{(y/,y, o yy,,;, o ■ ■ ■ o y/,_,,/,)(i); 

(;i,...,;,)e{l,...,«}'}} i^l,...,k (5.68) 

Moreover, if P e A""*" is bounded, then system (1.3) with output Y = H(t, x) satisfies 
the UIOS property with gain y — a'[ o e A/i from the input u e Mu . 

Proof We want to show that all hypotheses of Theorem 5.1 hold with S(t) = 0?" 
and 

L(t,x):^ma\\w(t,x), max Vi(t,x)] (5.69) 

I i=\,...,k I 



Notice that Hypothesis (SG3) of Theorem 5.1 is a direct consequence of inequal- 

h 



ities (5.64), definition (5.69), and inequality (5.63) with^(x) :— a, (max,=i ... ,tx/) 



for all X €*){'! . 

Finally, notice that since S{t) = di", we can select the time f involved in Hy- 
pothesis (SG2) to be f = tQ. Consequently, inequalities (5.6), (5.7), (5.8), and (5.9) 
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are automatically satisfied for appropriate functions. Thus, we are left with the task 
of proving inequalities (5.4) and (5.5). 

Consider a solution x{t) of (1.3) corresponding to arbitrary {u,d) e My x Mo 
with arbitrary initial condition x(fo) — xq e di" . Clearly, there exists a maximal ex- 
istence time for the solution denoted by fniax < +oo. Define V,(0 — Vi(t,x(t)), 
i — I, . . . ,k, W(t) — W{t, x(t)) absolutely continuous functions on [fo, Wx), and 
L(t) — L{t,x(t)). Moreover, let / C {to, ?max) be the zero Lebesgue measure set 
where x(t) is not differentiable or x(t) ^ f(t, x{t), uit), d{t)). By virtue of (5.66), 
it follows that the following implication holds for t e [fo, ?max)\^ and i — \, . . . ,k: 

y,(0>maxk(|M(0|), max K/./(V/(0)l ^ Vi{t) < - Pi{Vi{t)) (5.70) 

and by virtue of (5.65), we get, for t e [to, ttnax)\I, 

W(t)<-Wit) + Xmax\H\u(t)\), max p/(V/(f))| (5.71) 

Lemma 2.14 in Chap. 2, in conjunction with (5.70), implies that there exists a family 
of continuous functions ctj (i — I, . . . , k) of class KL, with ct, (s, 0) — s for all s > 
such that, for all t e [to, fmax) and i — I, . . . ,k,we have 

Viit) <mixx\(Ji{Vi{to),t - to), sup a,( max sup yij{Vj(s)),t - r), 
' ro<T<t ^j=l,...,ktQ<s<T ' 

sup (Ji\K\ sup |m(.j)| 1, f — r J ! (5.72) 

Moreover, inequality (5.71) directly implies that, for all t e [to, fmax), 

Wit)<Wito) + Xmax\^( sup \u(s)\), max pj( sup Vj(s))] (5.73) 

Let (T(s,t) :— max,=i .. ,t CT,(.s', f), which is a function of class KL that satisfies 
(j(s, 0)=s for all .? > 0. It follows from (5.72), (5.73), and definition (5.69) that, 
for all t e[to, ?max) and i — I, .. . ,k, 

Vi(t)<max\Vi{to), max y/,/( sup V/ (.?)), ^( sup |m(5)|)) (5.74) 

I j=l,...,k ■ \to<s<t ' ' \o<s<t ' > 

y,(0<max{CT(L(fo),f-fo), max y;,y( sup y/(.j)),^( sup |m(5)|)| (5.75) 

I j=\,....k ^to<s<t ' ^to<s<t '> 

W(f)<maxl- W(ro),^( sup |m(.j)|), max p, f sup Vi{s))\ (5.76) 

Clearly, inequalities (5.75) show that (5.4) holds with T : 9t^ ^ S1{+, r(x) = 
(7^1 (jc), . . . , r„(x)y with Fiix) — maxy=i J. yijixj) for all / = I, . . .,k and x e 
Dt!j_. Furthermore, the small-gain conditions hold for the MAX-preserving mapping 
r : ;)i^ -^ 9{^ as well. Moreover, inequalities (5.74) and (5.76) imply that the fol- 
lowing estimates hold, for all f e [fo, ^max), 
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max V,(r)<max{ max Vi(to), max max v/ ,{ sup Vi{s)), 

i = l,...,k l/ = l, ...,<: i = l,...,kj = l,...,k \tQ<s<t ' 

A sup |m(^)|)) (5.77) 

Define 

p"(5) — ^(5) Vi>0 (5.78) 

p(x):=max! max v; ;(x,), max p/(x/)! Vx e Dfil (5.79) 

Combining estimates (5.76), (5.77) and exploiting definitions (5.69), (5.78), and 
(5.79), we get, for all t e [to, fmax), 

L(t)<max\h{L(to)),p( sup Vi(s),..., sup V^(i)),p"( sup \u(s)\)] (5.80) 

where h(s) :— j^. Inequality (5.5) is a direct consequence of (5.80), inequal- 
ities (5.63), (5.64), and Lemma 3.2 in Chap. 3 with v(t) = 1, p" e Afu and 
p e J\f„ as defined by (5.78), (5.79), and appropriate a e Afi and c e K~^. The 
reader should notice that if yS e K~^ is bounded, then c e A""*" is bounded as 
well. 

Consequently, all hypotheses of Theorem 5.1 hold with (T(s,t) :— 
max,=i ... ,tcr,(i', r), which is a function of class KL that satisfies ct{s,0) — s for 
all 5 > 0. The rest of the proof is a consequence of (5.12) in conjunction with defi- 
nitions (5.78), (5.79). The proof is complete. D 

For the ISS case where H(t, x) — x, one can set W(t, x) = in Theorem 5.3 
to arrive at a corollary on the vector Lyapunov function characterization of the ISS 
property. 

Corollary 5.1 (Vector Lyapunov function characterization of the ISS property) 
Consider system (1.3) under Hypotheses (Hl-5) and suppose that there exists a 
family of functions Vi € C (SU"*" x Sli"; DJ"*") ((' = 1, . . . , ^), functions a\,a2 € Koo 
P e K'^ , f e TVi, y,-,/ e J\fi, i, j — 1, ■ . . , k, and a family of positive definite func- 
tions Pi e C°(S1{+; S1{+) {i — I, ...,k) such that 

ai(|x|)< max Vi{t,x) <a2{P{t)\x\) for all it,x) em+ x m" (5.81) 

i = l,...,k 

and implication (5.66) holds for every i — I, . . . , k and (?, x, u) e Di"*" x 9{" x U . 
If additionally, the small-gain conditions (5.3) hold, then system (1.3) satisfies the 
ISS property with gain y — a^ o 6 e I\f\ from the input u e Mjj , where 6 e Mi is 
defined by (5.67), (5.68). Moreover, if P e A""*" is bounded, then system (1.3) satisfies 
the UISS property with gain y — a'^ oQ e. M\ from the input u e Mu . 

Finally, we present an additional result for autonomous systems for which the 
set-valued map S{t) does not coincide with the whole state space. Consider the 
following nonlinear system described by ODEs of the form: 

jc^f(x,d,u) xem",deD,ueU (5.82) 
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where D C Dt', C/ c *){'" with e C/, and / : Sit" x £> x C/ ^ Sit" is a continuous 
mapping with f(0,d,0) — for all cf e Z). 

Theorem 5.4 Consider the autonomous system (5.82) under Hypotheses (HI), 
(H3) and suppose that there exist functions h e C {W; 9t) with h(0) < 0, V/ e 
Cn9r;S)i+) (i = 1,...,A:), a rarf/a/Zy unbounded function W e C\dl";di+), 
a function S e C (Sit"*"; (0, +oo)), a nondecreasing function K e C {'iR'^; Ot"*"), 
ai, 02 C Kao, ^ e A/":, y,-,/ e A/i, (', y = 1, • ■ ■ , k, and positive definite functions 
Pi e C (Ot"*"; Sf"*") (i = 1, . . . , A:) such that the following inequalities hold: 

ai{\x\)< max V,(x) < a2(|x|) for all x em" with h(x) <Q (5.83) 

i = l,...,k 

supS/h(x)f(x,d,u)<-S{h(x)) for all (x,u) em" x U with h{x) >0 (5.84) 

sup yWix)f(x, d, u) < K{h(x))W(x) + K{h(x))^{\u\) 
deD 

for all {x,u)e S)i" x U with h(x)>0 (5.85) 

Moreover, for all i — I, . . . , k and x e m" with h{x) < 0, the following implication 
holds: 

"(/ maxU(|M|), max yi.j{Vi(x))\ <Vi(x), 
then supVy,(x)/(jc,fi;,M)<-p,(V,(x))" (5.86) 

Also suppose that the MAX-preserving mapping F : 3{^ — >• Di^ with Fix) — 
{r\{x), . . . , Fjiix))', Fi(x) — maxy■=l_...,^. Yi,j{xj) for all x e m\, i — \, ... ,k, sat- 
isfies the cyclic small-gain conditions. Then the following statements hold: 

• IfW e C (Di"; S){+) is positive definite, then system (5.82) satisfies the UISS prop- 
erty from the input u e U . 

• IfU = {0}, then system (5.82) is URGAS. 

Proof of Theorem 5.4 Consider a solution x{t) of (5.82) corresponding to arbitrary 
{u,d) e Mfj X Mo with arbitrary initial condition x (0) — xq e m" . Clearly, there 
exists a maximal existence time for the solution denoted by fniax < +oo. Suppose 
that h(x{ty) <0 for all t e[0, fmax) and let Vj (t) — V,- (x (0) , / = 1 , . . . , A:, be ab- 
solutely continuous functions on [0, ?max)- Moreover, let / C [0, fmax) be the zero 
Lebesgue measure set where x(f) is not differentiable or x(t) ^ f{x(t), d(t), u(t)). 
By virtue of (5.86), it follows that the following implication holds for t e [0, fmax)\^ 
and i — 1, . . . ,k: 

Vi(t)>max\^{\uit)\), max y/,/(V/(0)) ^ Vi (t) < - Pi {Vi (t)) (5.87) 

Lemma 2.14 in Chap. 2, in conjunction with (5.87), implies that there exists a family 
of continuous functions ct, (/ = 1, . . . , A:) of class KL with a, {s,0) — s for all 5 > 
such that, for all t e [0, fmax) and i — 1, . . . ,k. 
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V/(r) < max{a,(y/(0),f), sup aA max sup yij[Vj(s)),t — r), 

sup a,(^( sup |M(i)|),f-r)| (5.88) 

0<T<r ^ ^0<.s<r ^ ' ' 

Let a(s,t) :— max/~i .. ,tCT,(s, r), which is a function of class KL that satisfies 
a{s, 0)^s for all s > 0. It follows from (5.88) that, if the solution x(t) of (5.82) 
satisfies h(x(t)) < for all t e [0, ?max), then the following inequalities hold for all 
t e [0, fmax) and i — I, . . . ,k: 

Vi(t) <ma.\\ a I max y,(0),M, max y,.y( sup Vjis)),n sup |m(5)|)[ 

(5.89) 

Since system (5.82) is autonomous, we need to consider only the case where the 
initial time is 0. Consequently, (5.89) implies that Hypothesis (SGI) holds with 
r : 9t^ -> dli, r(x) = (Fiix), . . . , r„(x)y with /l(x) = max/=i,...,i njixj) for 
all i = 1 , . . . , A: and x e S){!j_ , and 

Lit,x) := max Vi (x) for all (t, x) e S1{+ x di" and 

;=!....,*: (590) 

S{t) := 5 = {x e ;«" : h(x) < 0} for all f > 

Furthermore, if U — {0}, then, inequality (5.89) and definitions (5.90) imply that 
Hypothesis (SG4) holds. Definitions (5.90), in conjunction with (5.83), show that 
Hypothesis (SG3) holds as well with q(x) :— Aj (max,=i ^. x,) for all x e 9{^, 
H(t,x):^x for all {t,x)edi+ xdi", g = 0, K(t) ^ fi(t) = I, and b{s) -.^ a~\s) 
for all 5 > 0. 

It should be noticed that inequality (5.84) guarantees that the set S — {x e f){" : 
h(x) < 0} is positively invariant for system (5.82) and for every applied input 
(u,d) e Mu X Md- 

We next consider the solution x{t) of (5.82) corresponding to arbitrary (m, d) e 
Mu X Mo with arbitrary initial condition x(0) — xq ^ S. Define 

§ := sup{r e [0, r^ax) : h{x{t)) > 0} (5.91) 

The continuity of h and the fact that x(Q) = xq ^ S imply that f > 0. Defini- 
tion (5.91) and positive invariance of the set S = {x e di" : h(x) < 0} implies that 

(a) /!(x(0)>Oforallf e[0,^), 

(b) Either f = fmax, or § < fmax and /z(x(t)) = 0. 

Therefore, inequalities (5.84), (5.85) imply that the following differential in- 
equalities hold: 

h{t) < -&{h{t)) for almost all ? e [0, t) (5.92) 

W{t)<K(h(t))W{t) + K(h(t))t;{\u{t)\) for almost all f e [0, t) (5.93) 

where h{t) :— h(x(t)) and W(t) :— W(x(t)). Inequality (5.92) implies that the map- 
ping t —^ h{t) is nonincreasing on [0, §). Using the fact that K is nondecreasing, we 
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obtain from (5.92) and (5.93) the following inequalities: 

0<hit)<hixQ)-St forallre[0,t) (5.94) 

Wit)<txp{K{h(xQ))t)\wixo)+ sup f(|M(r)|)l for all f e [0, ^) (5.95) 
L o<T<f -^ 

where S :— minQ<s<h(xo) ^(■^) > 0- 

We next show by contradiction that the case ^ — fmax cannot happen. Suppose 

that § = fmax- 

• If ?max < +00, then necessarily limsup,^^- \x{t)\ — +oo. Since W is radially 
unbounded, we must have limsup,^,- W(x(t)) — +oo. On the other hand, in- 
equality (5.95) shows that there exists a finite constant A > such that W{x(t)) < 
A for all t e [0, ?rnax), a contradiction. 

• If § = fmax = +00, then inequality (5.94) shows that < h(t) < h{xQ) — St for all 
f > 0, again a contradiction. 

Therefore, we can conclude that f < /max and h(x(^)) — 0. Inequality (5.94) 
implies that ^ < ^. 

Positive invariance of the set S — {x e di" '■ h{x) < 0} implies that, for all x(0) — 
XQ e di" and {u,d) e Mu x Md, there exists f e [0, Wx) with f < S(xo) satisfying 
x{t) eS for all f e [§, Wx), where 

maxlO, h(x)} 
^^^^- ,, , (5.96) 

mino<.5<max{0./!(.v)) 0{S) 

It should be noticed that the function E : iH" —>■ SH+ defined by (5.96) is a continuous 
mapping with S(0) — 0. Therefore, there exists A e Koc such that S(x) < A{\x\) 
for all x e 9i". It follows from all the above that inequalities (5.7), (5.16) hold 
with c(t) = 1. Moreover, definition (5.90) and (5.95) implies that inequalities (5.5), 
(5.14) hold with p{x) := max,_j=i_...^i y,_/(x,) for all x e J){^, v(t) — c{t) = 1, 
p" =0, and arbitrary a e Koc ■ 

In order to finish the proof, we have to show the following. 

• There exist a,ri e A/i such that (5.8) holds with H{t, x) :— x, c(t) = 1 for the 
case that W e C^{di"; 9i-|_) is positive definite. Notice that inequalities (5.6), (5.9) 
are direct consequences of (5.8) with H(t,x) :— x, c(t) = 1 and (5.83), (5.90) for 
appropriate a , fj,g" e Kqc andc(f) = 1 . In this case the conclusion of the theorem 
follows from Theorem 5.1. 

• There exists a e Koc and /? > such that (5.15) holds with v(f) = c(f) = 2(1 + 
R) for the case U — {0}. Notice that inequality (5.17) is a direct consequence of 
(5.15) with v(t) = c(t) = 2(1 + R) and (5.83), (5.90) for appropriate a e Koo, 
c e K~^. In this case the conclusion of the theorem follows from Theorem 5.2. 

If VK e C '(?){"; S)}"*") is positive definite and radially unbounded, then (Propo- 
sition 2.2) there exist bi,b2 e Koc such that fcid^l) < W(x) < b2i\x\) for all 
X e di". Moreover, using the fact that ^ < S(xo), from (5.95) we obtain, for all 
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x(0) = XQ e di", (m, d)eMu X Md, and t e [0, ^], 
bi{\x{t)\)<W(t), 

W(t)<exp{K{miix{Q,hixQ)})t)\w(xo)+ sup ^(|m(t)|) 

L 0<T<r -I 

<exp(^(max{0,/!(xo)})£'(xo))rW(xo)+ sup ^(|M(r)|) 

L 0<T<I ■' 

= exp{K{max{0,h(xQ)})S(xo))W(xo)+ sup ^(|M(r)|) 

0<r<r 

+ (exp(/i:(max{0,/!(xo)})S'(xo))-l) sup ^{\u{r)\) 



0<T<l 



■■exp[K[max{Q,h(xo)})S{xo))b2{\xo\)+ sup ^(|m(t)|) 

0<T<f 

+ Uexp{K{max{0, h(xo)})S(xo)) - if + I; sup ?^{\u(r)\) 

^ ^ 0<T<t 



< max 



2exp{K{max{0,h{xo)})Sixo))b2{\xo\) 



+ -(exp(/:(max{0,/!(xo)})S(xo))-l) , sup A(|M(r)|) 

^ 0<T</ 

where A{s) :— ^^(s) + 2^(s). Since the mapping 

9t" 9 jc ^ B(x) ;= 2exp(/:(max{0, /!(x)})S(x))fo2(|x|) 

1 9 

+ -(exp(/«:(max{0,/z(x)})S(x)) - l) 



is nonnegative, continuous, and vanishing at zero, by virtue of Lemma 2.4, there 
exists £13 e K^o such that B(x) < iisdxl) for all x e d\". The above inequalities 



show that (5.8) holds with H(t,x) := x, c(0 = 1, ??(.?) := 6, ^AC^)), and a{s) := 



^r'(^3(^)). 

Finally, ifU — {0}, then we can define the function P : S1{" —>■ di~^ by 

Pix) := maxjlyl : y e *){", WCy) < exp(^(max{0, /z(x)})S'(x))W(x)} (5.97) 

Notice that since W is continuous, nonnegative, and radially unbounded, the func- 
tions P : di" —>■ di~^ is locally bounded. Since P : ^H" -^ d\~^ is locally bounded, 
there exist b4 e Koc and R > such that P(x) < R + b4(\x\) for all x e !1{". 
From (5.95), (5.97), and the fact that P(x) <R + b4(\x\) for all x e *){", the fol- 
lowing inequahty holds for all x(0) — xq e SW", (u,d) e My x Mp, and r e [0, f ]: 

|x(0| <max{2/74(|xo|),2^} (5.98) 

Therefore, inequality (5.15) holds with v(t) — c(t) = 2(1 + R) and a{s) :— 2b4{s). 
The proof is complete. D 
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5.3.2 Vector Lyapunov Functionals for Systems Described 
by RFDEs 

Consider system (1.10) under Hypotheses (Sl^), where the output map H is inde- 
pendent of M e [/. The following theorem provides sufficient Lyapunov-like con- 
ditions for the (U)IOS property. The gain functions of the lOS property can be 
determined explicitly in terms of the functions involved in the assumptions of the 
theorem. The reader should recall at this point Definition 2.4 in Chap. 2 of the al- 
most Lipschitz on bounded sets functionals and the definition of the Dini derivative 
used in Lemma 2.16 in Chap. 2. 

Theorem 5.5 Consider system (1.10) under (Sl-4) and suppose that there exist 
{almost Lipschitz on bounded sets) functionals Q, : [—r + rj, +oo) x C ([— r,-, 0]; 
dl") -^ m+ with < r,- < r (/ = 1, . . . , k), Qq : [-r + ro, +oo) x C°([-ro, 0]; 
9i") — >• Df}"*" with < ro < r, functions ai,a2, 03,04 € ^cxd iJ',P,K € A""*", 
^ e A/i, g e AficYij e AA, pi e AA, i, j — I, ... ,k, positive definite functions 
Pi e C (di~^; Si"*") (/ — 1, . . . , k), and a constant X e (0, 1) such that, for all 
(t, x,u) Edi~^ X C ([—r,0];di") x U , the following inequalities hold: 

ai{\\H(t,x)\\^) < max Vi(t,x) <a2{Pit)\\x\\r) (5.99) 

■^ i = l,...,k 

a3{ixit)\\x\\r) - g{Viit, x),..., Vk(t, x)) - Kit) < Wit, x) < a4{Pit)\\x\\r) 

(5.100) 

sup Qo{t,TrgiO)x; fit,x,u,d)) 



deD 
< 



-Qo{t,TroiO)x)+Xmax^^{\u\), max pj{Vjit,x))j (5.101) 



j=h-,k 

where 

Viit, x) := sup Qi {t + 9, Tr, i0)x) i = 1, 

ee[-r+n,o] 
Wit,x):^ sup Qo{t + e,Troie)x) 

eel-r+ro,0] 



(5.102) 



and for all i — \, ... ,k and it, x, u) e Di"*" x C^i[—r, 0]; 9i") x U , the following 
implication holds: 

ifmax\l;{\u\), max K,,/(y/(r,x))) < G,(f, r,,(0)x), 

then sup Ql{t, 7;,.(0)x; fit,x,u,d)) < -Pi{Qi{t, 7;,(0)x)) (5.103) 
deD 

Furthermore, suppose that the small-gain conditions (5.2), (5.3) hold. 

Then, system (1.10) satisfies the lOS property with gain y — a^ o e M\ from 
the input u e Mu , where 6 € Afi is defined by (5.67), (5.68). Moreover, if P & K'^ 
is bounded, then for every p e Koo, system (1.10) satisfies the UIOS property with 
gain y — a^ o 6 e A/i from the input u e Mu . 
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Proof of Theorem 5.5 We want to show that all hypotheses of Theorem 5.1 hold 
with S{t) = C°([-r, 0]; !){") and L(t, x) as defined by (5.69). 

Notice that Hypothesis (SG3) of Theorem 5.1 is a direct consequence of in- 
equalities (5.100), definitions (5.69), (5.102), and inequality (5.99) with q{x) :— 
aj~ (max,=i J. jf,) for all x e S){!j_. 

Finally, notice that since S{t) = C'^([—r, 0]; di"), we can select the time f in- 
volved in Hypothesis (SG2) to be f = Iq. Consequently, inequalities (5.6), (5.7), 
(5.8), and (5.9) are automatically satisfied for appropriate functions. Thus, we are 
left with the task of proving inequalities (5.4) and (5.5). The proof consists of two 
steps: 

Step r. We show that inequalities (5.4) and (5.5) hold for arbitrary (to, u,d) e M"*" x 

Mu X Md and r,(fo)jc =jco e C\[-r,0]; *){"). 
Step 2: We show that inequalities (5.4) and (5.5) hold for arbitrary (to,u,d) e St"*" x 

Mu X Md and Tr(to)x = xq e C°([-r, 0]; M"). 

Proof of Step 1: In this setup, consider the solution x(t) of (1.10) correspond- 
ing to arbitrary {u,d) e Mjj x Mu with arbitrary initial condition T,-{ta)x — 
XQ e C^([—r,0]; Of"). Clearly, there exists a maximal existence time for the so- 
lution denoted by rmax < +oo. By virtue of Lemma 2.17 in Chap. 2, we can 
guarantee that the functions Qi{t) — Qi{t,Tfj(t)x), i — l,...,k, and Qo(t) — 
Qo(t , Trf^it)x) are absolutely continuous functions on [fo>fmax)- Let V,(0 — 
Viit,Tr(t)x) = SUp0g[_,+,,_o] Qiit + 9), i ^l,...,k, W{t) = W{t,Tr(t)x) = 
supgg[_,._^^^ 0] Qoit + 0), and L(t) = Lit, 7X0^) be mappings defined on [fo, Wx)- 
By virtue of (5.101), (5.103) and Lemma 2.16, there exists a zero Lebesgue mea- 
sure set I C[to, Wx) such that the following equations hold for t e [to, fmax)\^ and 
i^l,...,k: 

g,(r)>max sup ^(|mCO|), max sup yi.i{Vj{s))\ 

'■tQ<s<t j=l,---,kto<s<t > 

^ Qi{t)<-p!{Qi(t)) (5.104) 

Qoit)<-Qo(t) + XmeiX^^{\uit)\), max^p;(V,(0) j. (5.105) 

Lemma 2.14 in Chap. 2, in conjunction with (5.104), implies that there exists a 
family of continuous functions dj {i — 1 , . . . , k) of class KL with cf, {s,0) — s for all 
s > such that, for all t e [to, ?max) and i — I, . . . , k,we have 

Qi(t) <max\ai[Qiito),t - to); sup <t,( max sup >';,/(y/(i')), f - r ) 

•■ to<T<t ^.i='i-,--,kto<s<T ' ^ 

sup OiiA sup |m(j)|),?- r)} (5.106) 

Moreover, inequality (5.105) directly implies that, for all t e [to, fmax), 

Qo(t) <Qo(to) + kmax\^( sup \u(s)\), max /?/( sup Vjis))] (5.107) 

' ^to<s<t ' j=L...,k ■ \<s<t '' 

Using the fact that atis, Q) — s for all 5 > 0, from (5.106) we obtain, for all t e 
[fo,Wx) andi^l,...,k. 
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Qiit)<ma.x\ai{Qiito),t -to), max y/,/( sup Vjis)),n sup |M(i)|) 

I j = l....,k \<s<t ' \o<s<t '> 

(5.108) 

Let Oi {i — \, . . . ,k) be functions of class KL defined by a/ (5, t) — s for all s >Q, 
t e [0, r] and ct,- (s, t) — cr; {s, t — r) for sAl s >Q, t > r . Using the fact that V,- (f) = 
Vi{t, Tr{t)x) = supgg[_^_^^. 0] GKf + ^), '■ = 1, ■ ■ ■ , k, it follows from (5.108) that, 
for all f e [fo, ?max) and / = 1 , . . . , A:, 

V,(0 <max CT/(V,(fo),f-fo), max y,-,/( sup Vj(s)),n sup |m(5)|) 

(5.109) 

Similarly, using (5.107) and the fact that W{t) = Wit,Tr(t)x) = 
supgg|^_^_l_^ij Q] Qoit + 0), we conclude that (5.73) holds for all t e [to, fmax)- De- 
fine (T{s,t) := max,-i j.cr,(i',f), which is a function of class KL that satisfies 
ct(s, 0) = .? for all s > 0. It follows from (5.109) and definition (5.69) that inequal- 
ities (5.75), (5.76) hold for all t e [to, Wx) and / = 1, . . . , jfe. Clearly, (5.75) shows 
that inequalities (5.4) hold with T : 9t^ -> 9{^, r(x) = (ri(x), . . . , r„(x))' with 
Fiix) — max/=i ...,,t yijixj) for all / = 1, . . . , A: and x e dV!^_. Moreover, the small- 
gain conditions hold for the MAX-preserving mapping F : !1t^ -^ di\. as well. De- 
fine p" e M and p e 7V„ by (5.78) and (5.79). Combining estimates (5.75), (5.76) 
and exploiting definitions (5.69), (5.78), and (5.79), we get inequality (5.80) for all 
t e [fo, Wx)- Inequality (5.5) is a direct consequence of (5.80), inequalities (5.99), 
(5.100), and Lemma 3.2 in Chap. 3 with v(t) = 1, p" e J\fi, and p e Nn as defined 
by (5.78), (5.79) and appropriate a e N\ and c e K+ . Notice that if p e K+ is 
bounded, then c e K~^ is bounded as well. 

Proof of Step 2: Let (to,xo,u,d) e di+ x C\[-r,0]; 9t") x My x Mq. Inequal- 
ities (5.4), in conjunction with Proposition 5.3, imply that, for the solution x{t) 
of (1.10) corresponding to (u,d) e Mjj x Mo with initial condition Tr(to)x = xq e 
CHl-r, 0]; 9t") and for all t e [to, Wx), 

y(0<MAX{e(la(L(fo),0)),e(l^([||M(r)||Jj,^,j))} (5.110) 

where Q(x) ^ MAX{x, r(x), F^^Hx), . . . , r''"-^Hx)}. Using (5.99), (5.100), 
(5.69), (5.80), and (5.110), we obtain functions p e K^ and a e Koo such that, 
for the solution x(t) of (1.10) corresponding to (u,d) e Mjj x Mo with initial 
condition Tr {to)x —xoeC^ ({-r, 0]; W) and for all t e [to, ?max), 

\Tr{t)x\^.<a(p{t)+\\xo\\r+ sup |M(i)|) (5.111) 

Lemma 2.18 in Chap. 2 and (5.111) imply that system (1.10) is RFC from the 
input u e Mu and that inequalities (5.4) and (5.5) hold for all {to,xo, u,d) e 
9J+ X C°([-r, 0]; di") x M/j x Mo and t > to- Consequently, all hypotheses of 
Theorem 5.1 hold. The rest of proof is a consequence of (5.12) in conjunction with 
definitions (5.78), (5.79). The proof is complete. D 
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When H{t, x) — x, setting Q^it, x) = in Theorem 5.5 leads to a result on the 
ISS of system (1.10). 

Corollary 5.2 Consider system (1.10) under Hypotheses (Sl-4) and suppose that 
there exists a family of (almost Lipschitz on bounded sets) functionals Qt : [—r + r, , 
+oo) X C°([-r/, 0]; ^") -^ 9t+ with < n < r (i — I, . . . , k), functions fli, ai e 
^oo, P C K'^ , ^ e A/i, Yij e TVi, i, j — 1, . . . , k, and a family of positive defi- 
nite functions p; € C (Dt"*"; di'^) (i — 1, . . . ,k) such that, for all (t, x, u) e di'^ x 
C ([—r, 0]; 9{") x U, the following inequality holds: 

ai{\\x\\r)< max Viit,x) <a2{Pit)\\x\\r) (5.112) 

(=1,...,^ 



where 



Vi(t,x):^ sup Qi{t + 0,Tr,(e)x) i^\,...,k (5.113) 



and implication (5.103) holds for all i — \, . . . ,k and (t, x, u) e DJ"*" x C ([— r, 0]; 
Ot") X U . If moreover, the small-gain conditions (5.2), (5.3) hold, then system (1.10) 
satisfies the ISS property with gain y — a~^ o 9 e Afi from input u e Mj/, where 
9 ^ Ml is defined by (5.67), (5.68). Moreover, if P & A""*" is bounded, then sys- 
tem (1.10) satisfies the UISS property with gain y — a'^ o 9 e. J\f\ from input 
u e Mu. 



5.3.3 Vector Lyapunov Functions for Sampled-Data Systems 

We consider autonomous systems of the form (1.57) under Hypotheses (Al-5), 
where R is the identity mapping (no impulsive behavior), / and h are indepen- 
dent of cf(T,), and H is independent of m. More specifically, we consider systems of 
the form 

x{t)^ f{x{t),x{xi),d{t),u\{t),ui{xi)) t e [t,-,t,+i) 

to = to, T,+i = T; + exp(-M2(r/))/z(x(Ti), mi(t,)), / = 0, 1, . . . 

Yit)^H{x(t)) 

xit) e m'',d(t) e D, u{t) = (mi(0, m2(0) e [/ := C/i X i)i+ (5.114) 

The following theorem provides sufficient Lyapunov-like conditions for the (U)IOS 
property of system (5.114). The gain functions of the lOS property can be deter- 
mined explicitly in terms of the functions involved in the assumptions of the theo- 
rem. 

Theorem 5.6 (Vector Lyapunov function characterization of UIOS for sampled- 
data systems) Consider system (5.114) under Hypotheses (Al-5) and suppose that 
there exist nonnegative functions Vi e C\dl"; m+) (i = I, . . . , k), Q e C\dl"; 9i+), 
ai, 02, 03, 04 e Koo, i. e 7V1, g e Nk,Yi,j £ A/i, pt e A/i, i, j — \, . . ., k, constants 
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fj-, K >Q, X e (0, 1), and positive definite functions pi e 0(0}"*"; Ot"*") (/ = 1, . . . , A:) 
such that the following inequalities hold for all (x, xq, u, uq) e di" x !){" x Ui x U\: 

ai{\H(x)\)< max V,(x) < ajfkl) (5.115) 

i = l,...,k 

«3(kl) - g(Vi(x), . . . , Vk(x)) -K< Q(x) < «4(k|) (5.116) 

sup V Q(x)f(x, XQ, d, u, Uq) 
deD 

<fiQ(x) + kmax\^{\u\),^{\uo\), max pj{Vj(x)), max /?/(V/(xo)) 

I j = l,...,k 1 = 1, ...,k ' I 

(5.117) 

and for all i — I, . . . ,k and (x,u, uq) e S)i" x C/i x C/i, the following implication 
holds: 

''If maxK(l"l),?(l"ol), max K/,/(V/(x)) < Vi{x) and xq e Ai{hixo,uo),x), 
y j=i....,k I 

then sup VV/(jc)/(x,xo, fif, M, Mo) < — P/(V/(jc))." (5.118) 

deD 

where the family of set-valued maps Sit"*" x 9{" 3 {T,x) — >• A/(r, x) C S1{" (;' = 
1 , . . . , fc) w defined by 

Ai{T,x)— 1) {xQ e i){" : 3(£/, m) e Md X Mc/, w(f/i0(.s,xo; d, m) =x, 

0<.s<7" 

K{\u{t)\) < Vi(x),yij{Vj{4>(t,xo;d,u))) < V,(x) 

for all t e [0, s] and j^\,..., k] (5.119) 

and (p(t, xo; d, u) denotes the solution of x(t) — f(x(t), xq, d{t), u{t), m(0)) with 
initial condition x(0) — xq corresponding to (d, u) € Mo x Mu^ . 

Furthermore, if the small-gain conditions (5.2), (5.3) hold, then system (5.114) 
satisfies the UIOS property with gain y — a^ o 6 e TVi from the input ui e Mf/, 
and zero gain from the input uj e A/3J+, where e Mi is defined by (5.67), (5.68). 

For the ISS case where H{t, x) — x, one can set Q(x) = in Theorem 5.6 and 
obtain a result on the vector Lyapunov characterization of UISS. 

Corollary 5.3 (Vector Lyapunov function characterization of UISS for sampled-data 

systems) Consider system (5.114) under Hypotheses (Al-5) and suppose that there 
exists a family of functions V,- € C (9t"; Dt"*") (/ = 1, . . . , k), functions ai, 02 € Koq, 
^ e Afi,Yij € A/i, i, j — I, ■ . . ,k, and a family of positive definite functions pi e 
C (Dt"*" ; Dt"*" ) ii — \, . . . ,k) such that the following inequality holds for all x e Dt" : 

ai(|x|)< max y/(x) < a2(|x|) (5.120) 

and implication (5.118) holds for all i — \, . . . ,k and {x,u, mq) ^ ^■^" x U\ x U\, 
where the set-valued maps Ot"*" x St" 9 {T,x) —^ A,(r,x) C. di" (i — l,...,k) 
are defined by (5.119), and <f> (t , xq; d , u) denotes the solution of x(t) — 
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f(x{t),XQ,d{t),u(t),u{0)) with initial condition x(0) — xq corresponding to 
{d,u) e Md X Mu^. 

Under the small-gain conditions (5.2), (5.3), system (5.114) satisfies the UISS 
property with gain y — a^ o 9 e Afi from the input ui e My, and zero gain from 
the input U2 e M;ij+, where 9 e A/i is defined by (5.67), (5.68). 

Proof of Theorem 5.6 We want to show that all hypotheses of Theorem 5.1 hold 
with S{t) = m", L(t, x) as defined by (5.69), and 

W(t,x):^exp{-(fi+l)t)Q(x) (5.121) 

Notice that definition (5.121), in conjunction with inequalities (5.116), implies the 
following inequality for all (r, x) e di~^ x di" : 

exp(-(M + l)r)a3(|x|) - g{Vi(x), ..., Vk(x)) -k< W(t,x) < a4{\x\) 

Using Lemma 3.2 in Chap. 3, we can find functions a e Kqc and ri e K~^ such that 
a^ (s exp((/Lt + l)r)) < jjp-a(s) for all t,s >0. Consequently, we obtain 

exp(-(/x+ l)t)ai(s) >d~^[r]it)s) forallf, j > 

Notice that Hypothesis (SG3) with p{t) = I is a direct consequence of previ- 
ous inequalities, definitions (5.69), (5.121), and inequality (5.115) with q{x) :— 



a 



(max,-=i ... ,tx,) for all x e 9{!j_. 



Finally, notice that since Sit) = 9J", we can select the time ^ involved in Hy- 
pothesis (SG2) to be ^ = fo- Consequently, inequalities (5.6), (5.7), (5.8), and (5.9) 
are automatically satisfied for appropriate functions. Thus, we are left with the task 
of proving inequalities (5.4) and (5.5). 

Consider the solution x(t) of (5.114) under Hypotheses (A 1-5) correspond- 
ing to arbitrary (u\,d,U2) e My, x Md x M;ij+ with arbitrary initial condition 
x(fo) — XQ& !){". Notice that since system (5.114) is autonomous, it suffices to con- 
sider the case tQ — 0. There exists a maximal existence time for the solution de- 
noted by fmax < +00. Define Viit) = Vi(x{t)), i ^l,...,k. Wit) = Wit,x(t)), 
and L(t) — L{t,x(t)), which are absolutely continuous functions on [0, fmax)- 
Moreover, let it :— {to, ti, . . .} be the set of sampling times (which may be fi- 
nite if fjuax < +oo), p(t) '■— maxJT e n : r < t], and q{t) :— minjr e tt : r > t] . 
Let / C [0, fmax) be the zero Lebesgue measure set where x(t) is not differen- 
tiable or where x{t) ^ f(x(t),x(ri),d(t),ui{t),ui{ri)). Clearly, we have x(t) — 
(j){t-p{t),x{p{t))\ P,d, PfUi) for all t e [0, Wx), where (PfwOCO = Mi(p(0 + i), 
(Ptd)(s) — d(p(t) + s), s > 0. Next, we show that the following implication holds 
for t e [0, rmax)\^ and i — I, ...,k: 

y,(f)>maxK( sup |mi(.j)|), max y,-,/( sup V/(i')) 

^ Vi{t)<-Pi{Vi{t)) (5.122) 

In order to prove implication (5.122), let t e [0, ?max)\^, i = I, . . . ,k,r = p(t), and 
suppose that 

y,(0>maxK( sup |mi(5)|), max yij( sup Vj(5)) 
p(t)<s<r ' ;=i.-.* ^p(t)<s<t ' ' 



232 5 Advanced Stability Metliods and Applications 

By virtue of the semigroup property, the previous inequahty implies that ^ ( | m i (r + 
s)\)^^{\{P,ui)(s)\)<Vdx(t)),yij{Vj{<l,(s,x(ry, P,J, ^mO)) < \^(x(0) for all 
s e [0, t — r] and j — I, . . . ,k. In this case, by virtue of definition (5.119) and the 
fact that t — T < h(x(r),ui(r)), it follows that x{r) e Ai{h(x(r), ui(r)), x(t)). 
Since x{t) — f(x(t),x(r),d(t),ui{t),ui{r)), we conclude from (5.118) that 
Vi(t)<-p^(Vi(t)). 

Lemma 2. 14 in Chap. 2 implies that there exists a family of continuous functions 
cr,- of class KL (i — I, . . . ,k) with a, (s,0) — s for all i' > such that, for all t e 
[0, ?max) and i — I, . . . ,k,we have 



Vi(f) < max{cr,(V,(0), f); max sup cnlviji sup Vjis)),! — r); 

I j = l,...,<:o<T<r ^ ' ^p(t)<s<t ' ' ' 

sup oAt^i sup |M(i)| j,r — T j ! (5.123) 

0<r<f ^ ^p(T)<.s<r ' '^ 

Let c!(s,t) :— max,=i ... ,t a,(5, f), which is a function of class KL that satis- 
fies ct(s,0) = s for all s > 0. Inequahties (5.4) with T : i)}^. ^ f){^, r(x) = 
(Fiix), ... , r„(x)y with Fiix) — maxy=i,..._j: yijixj) for all ( = I, . . . ,k and x e 
^"^_, are direct consequences of the previous definition, estimates (5.123), defini- 
tion (5.69), and the fact that ct, (s,0) = s for all i' > and i — 1, .. . ,k. 
Exploiting (5.117) and definition (5.121), we get, for t e [0, fmax)\^, 

W(t)<-Wit) + Xmax\^( sup |m(s)|), max pj( sup Vj(s))\ (5.124) 
^ ^p(r)<s<r ' 7=1, ■■■•<: ' ^p(t)<s<t ' '' 

Inequality (5.124) directly implies that, for all t e [0, fmax)> 



H^(r) < max 



— '— H^(0),^( sup |m(^)|), max pi( sup ;^(^))] (5.125) 

1 — A ^0<s<t ' i = L...,k ^0<s<r ^\ 



Moreover, (5.123) and (5.125) imply that estimates (5.75), (5.76) with f o = hold 
for all t e [0, ?max)- Define p" e M and /? e A/], by (5.78) and (5.79). Combining 
estimates (5.75), (5.76) with f o = and exploiting definitions (5.78), (5.79), and 
(5.69), we obtain (5.80) for all t e [0, fmax) with h{s) :— j^ and to — 0. Inequality 
(5.5) is a direct consequence of (5.80) with Iq — 0, inequalities (5.115), (5.116) with 
v(t) — c(t) = 1, p" e JVi, p e Nn as defined by (5.78), (5.79), and appropriate 
aeUi. 

Consequently, all hypotheses of Theorem 5.1 hold with a{s,t) :— 
max,=i...,t cr/(i', f), which is a function of class KL that satisfies (r(s,0) — s for 
all i > 0. The proof is complete. D 

Remark 5.1 When we consider the special case of the feedback interconnection of 
two subsystems, as illustrated in Fig. 1.2, the small-gain results of this chapter are 
generalizations of the first nonlinear, ISS, small-gain theorem presented in [21]. In 
this case, the cyclic small-gain conditions (5.2) and (5.3) reduce down to yi2 o yii < 
Id, which is mathematically equivalent to y2i ° Yn < td. It is important to notice that 
the original nonlinear small-gain theorem in [21] tackles interconnected systems 
described by ODEs and naturally assumes that yn — Y22 = 0. 
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5.4 Examples and Applications 

In this section, we present examples and applications of the results of the previous 
sections. More specifically, the first two examples illustrate how we can use vec- 
tor Lyapunov functions in order to prove global asymptotic stability of time-delay 

systems. 

Example 5.4.1 Consider the time-delay system of the form 

Xi{t)^-aiXi{t) + gi{d{t),Tr(t)x) / = l,...,n (5.126) 

where d{t) e D <Z J)f", a/ > (( = 1, . . . , n) and g/ : Z) x C°([-r, 0]; S)t") -^ *){ 
{i — \, . . . ,n) are continuous mappings with 



sup g;((i,x) < max c; /||.Xy||r (5.127) 

rfeD j=l,...,« 



and 



sup[(x,(0) - yi{Q)){gi{d, x) - giid, y))] <L\\x- y\\l / = !,...,« 

deD 

for certain constants L > 0, c,,y > (i,i — !,...,«), and for all x,y & 
C°([-r,0]; 9t"). We next show that e C°([-r,0]; 9i") is RGAS for (5.126) if 
Cij < Uj for all i — I, . . . ,n and the following small-gain conditions hold for each 

r — 2, . . . , n: 

for all ij e {I, . . . , «}, ij ^ ik if j ^ k. 

First, we notice that Hypotheses (S 1-4) hold for system (5. 126) under hypothesis 
(5.127) with output H(t, x) :— x e C*'([-r, 0]; M"). Define the family of functions 
Qiix) = 5X^(0) and y,(x) := supgg[_,.o] g,(x(0)) = jUx,- \\j. (/ = !,...,«) forx e 
C^i[—r,0]; di"). These mappings satisfy inequality (5.112) and definition (5.113) 
with ai(s) :— j^s'^, aiis) '■— ^s^, Pit) = I, and r,- :— 0, i — I, . . . ,n. Let k e 

(0, 1) and notice that implication (5.103) holds with yijis) :— -^^s and p,(s) :— 

2(1 — k)aiS. Condition (5.128) and the fact that c/_, < a, for all / = !,...,« implies 
that the small-gain conditions (5.2), (5.128) hold for X e (0, 1) sufficiently close 
to 1. We conclude from Corollary 5.2 that e C°([-r, 0]; Di") is RGAS for (5.126). 
It is important to notice that the conditions on the diagonal terms cannot be 
avoided in general if Razumikhin-like functions are used. Such a situation occurs, 
for example, when 

x\(t) — -aixi(r) + ci,iiii(r)xi(f - r) + Ci^2d2(t)x2(t - r) 
X2(t) — -a2X2(t) + C2,\dj,{t)xi{t) 
J/(Oe[-l, !],(•= 1,2, 3 

with ci,i > 0, ci,2 > 0, and C2,i > 0. In this case, e C^{[-r, 0]; m'^) is RGAS for 
the above system if cij < a\ and ci_2C2,i < flia2- 
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Example 5.4.2 Consider the following biochemical control circuit model: 

Xiit)^g{X„(t-rn))-aiXiit) 

Xiit) = X,_i(f - T,_i) - aiXiit) / = 2, . . . , M 

X(t) = {Xi(t), ..., X„{t))' e m'l (5.129) 

where a, > and Tj > (i — 1, . . . , n) are constants, and g e C^!)}"*"; 9{"'") is a 
function with g{X) > for all X > 0. This model has been studied in [46] (see 
pp. 58-60 and 93-94). In this book it is further assumed that g e C\^i+- *){+) is 
bounded and strictly increasing (a typical choice for g e C'(S){"'"; S)}"*") is g(X) — 
jtyp with p being a positive integer or giX) — -j^j-^ with /Lt, c > 0). It is shown 
that if there is one equilibrium point for (5.129), then it attracts all solutions. If there 
are two equilibrium points, then all solutions are attracted to these points. Here we 
study (5.129) under the following assumption: 

(H) There exist Z* > 0, /: > 0, and X e (0, 1) with aX* = giX*) and such that 

V^ _1_ v* 

-X<a-^g(X)<X* + X\X-X*\ forallZ>0 (5.130) 

K -\- X 

where a — 11'/= i ^1- 

The reader should notice that Hypothesis (H) is automatically satisfied for the 
case of Monod kinetics, i.e., g(X) — j^r-^ with c > and /x > ac. Indeed, in this 
case inequality (5.130) holds with i*: = c and 1 = ^^, where X* = ^^. The 
case of Monod kinetics is typical for biochemical models. 

Using small-gain analysis arguments, we are in a position to prove: 

"Consider system (5.129) under Hypothesis (H) and let r :— max,=i „ t,. 
Then for every Xq e C°([-r, 0]; int{m"^)), the solution of (5.129) with ini- 
tial condition T,(Q)X — Xq satisfies limf^+oo-^(0 = X*, where X* — 
(Z*, . . . , X*y e int(M;) with (0 ■=! aj)X* = g(X*) for / = 1, . . . , « - 1." 

In sharp contrast to the analysis performed in [46] for (5.129) based on the 
monotone dynamical system theory, we do not assume that g e C'(Dt"'"; Dt"*") is 
bounded or strictly increasing. Moreover, even if there are two equilibrium points 
(e.g., e 9i!j_ can be an equilibrium point, because (5.130) allows ^(0) — 0), we 
prove almost global convergence to the nontrivial equilibrium. 

A typical analysis of the equilibrium points of (5.129) under Hypothesis (H) 
shows that there exists an equilibrium point X* e int(!;1{!j_) satisfying 

maAx*^g{x:) (5.131) 

In order to be able to study solutions of (5.129) evolving in int(9't!|_), we consider 
the transformation 

Xi^Xfexpixi) (5.132) 
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Therefore system (5.129) under transformation (5.132) is expressed by the follow- 
ing set of differential equations: 

xi=ail — exp(-xi(0)- 1 1 (5.133) 

i,(0 = a/(exp(x,_i(f-Ti_i)-x,(f))-l) / = 2,...,n (5.134) 

x(f) = (xi(r), ...,jc„(f))'eS1{" 

First, we notice that Hypotheses (Sl^) hold for system (5.133), (5.134) un- 
der Hypothesis (H) with output H(t,x) := x e C°([-r,0];di") and that e 
C°([-r, 0]; dl") is an equilibrium point for (5.133), (5.134). 

Define the family of functions Qi(x) — jxf(0) and Vi(x) :— 
sup0g[_,o] Qi(x(e)) = i||jc,||2 ((• = 1, ...,n) for jc e C°([-r,0]; *){«)■ These map- 



pings satisfy inequality (5.112) and definition (5.113) with ai(s) :— j^s^, ajis) :— 



r.Q] 
S Si 

^s^, Pit) = 1, and r,' :—0,i — l,...,n. Set yi,j(s) = for j ^ n and yi,„(i) := 
' [log(l + 0(exp(V27) - 1))]2, where 6 e (max{^, A}, 1), X e (0, 1) being the 

K_ 

X* 



constant involved in Hypothesis (H), and b:— y*. Notice that 



no( ,m /g(^^exp(x„(-r„))) 

Q\ ( XI (0); fli ( — exp(-xi (0)) - 

= ^^^^^^\ ^(X^O exp(-xi(0)) - Ij 

We consider the following cases: 

(1) xi(0) < 0. In this case, the left-hand side of inequality (5.130) implies that 

g(X*exp(x„(-T„))) b+\ I , .\ 

exp(x„(-T„)j 

exp(-|x„(-T„)|) 



g(X*) fo + exp(x„(-T„)) 

b+\ 



fo + exp(-|x„(-r„)|) 

K 

with b :— — 

X* 

The inequality yi,„(V„(x)) < 2i(xi(0)) implies ln(l + 0(exp(|x„(— t„)|) — 
1)) < — xi(0), which combined with the previous inequalities, gives 

Gi(^xi(0);ai(^ -^^ exp(-xi(0))-ljj 

^ ,,, (^+l-feg-')(exp(-xi(0))-l) 

<aixi(0) i . (5.135) 

- ^+ 1 + ^(9- i(exp(-xi(0))-l) 

(2) xi (0) > 0. In this case, the right-hand side of inequality (5.130) implies that 

g(Z*exp(x„(-r„))) ^, , ., , . ,x ., 

— — < 1 + Aexp(x„(-T„))-1 

g{Xl) 

<l + A(exp(|x„(-r„)|)-l) 
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The inequality yi,„(V„(x)) < Qi(xi(0)) implies ln(l + 0(exp(|x„(— t„)|) — 
1)) < xi (0), which combined with the previous inequalities, gives 

Gi (^xi(O); ai (^ -^^ exp(-xi (0)) - 1 j j 

<aixi(O)(A0-'-l)(l-exp(-xi(O))) (5.136) 

Combining these two cases, we obtain from (5.135) and (5.136) that the follow- 
ing implication holds: 

yxA^nix)) < Qi{xim) 

,n^ /^(^*exp(x„(-T„))) , \\ 

'^^^'"'y ^^^^i:^ exp(-.Ti(0))-ljj 

-Pi(ei(^i(0))) (5.137) 



with 

:— aiV2jmin 



(l-X(9-^)(l-exp(-V2s)) 



(b+l- fc6»-^)(exp(V2^) - 1) 
/7+l+fe6»-i(exp(V27)- 1) 



Fori — 2,...,n, define yii-i(s) :— 2[log(l-|-/x(exp(\/2j) — 1))]^ and Yijis) = 
for J ^ i — 1, where /x > 1 is to be selected. Working in a similar way as above, 
we obtain, for i — 2, . . . ,n, 

yi,i-i{Vi{x))<Qi{xiiO)) 
^ e°(x,(0);fl,(exp(x,_i(-T,_i)-.^,(0))- 1)) <-p,(e,(x,(0))) (5.138) 

with piis) := (1 - /x~')fl,V2^ (i-exp(-V2F)) fo^ ,■ ^ 2, . . . , n. 

Therefore, we conclude from (5.137) and (5.138) that implication (5.103) holds. 

Finally, we check the small-gain conditions. Exploiting the previous definitions 
of the functions yij{s), i,j — !,...,«, we conclude that the small-gain condi- 
tions (5.2), (5.3) hold if and only if (y„,n-i o )/„_i „_2 o ■ ■ ■ o yi, „)(.?) < s for all 
5 > 0. Since 



iyn,n-l oK«-l,n-20---oyi,«)(^) = -[log(l-h/x" 0(exp(VZj)- l))] 



1 



the small-gain conditions (5.2), (5.3) hold with fj, e (l , 9~ "^ ) . Thus, Corollary 5.2 
implies that e C°([-r, 0]; J){") is Uniformly Globally Asymptotically Stable for 
system (5.133), (5.134). Taking into account transformation (5.132), this implies 
that for every Xq e C°([-r, 0]; int(i)i'|)), the solution of (5.129) with initial con- 
dition Tr{0)X = Zo satisfies limt^+^ X{t) = X*, where X* = (X*, . . . , X*)' e 
int(af{^) with (n ■=! aj)X* = g(Z*) for / = 1, . . . , n - 1. 

The following example indicates that the trajectory-based small-gain results of 
the previous section can be used to study the feedback interconnection of systems 
which do not necessarily satisfy the lOS property. 
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Example 5.4.3 Consider the system 

X — f(d, X, y, u) 

y^g(d,x,y) 

X e di", y e m'', deDc 9t', u e m"" (5.139) 

where D C 9t' is a nonempty compact set, / : Z) x S){" x di^ x S){"' -^ S){", and 
g : D X dl" X J){* —^ dl'^ are locally Lipschitz mappings with /(cf, 0,0,0) — 0, 
g(d, 0, 0) = for a\ld e D. Suppose that there exist positive definite, continuously 
differentiable, and radially unbounded functions Vi : S)f' -^ Dt"*", Vj '■ S)t* -^ Dt"*", 
a constant a e [0, 1], and a function A; e ^oo satisfying the following inequalities 
for all (x, y, u) e 9J" x m'' x 9^: 

max VVifx) f{d, x, y, u) 
deD 

< -{2 + a)- — — — + (1 -fl) 



l + VlW '(l + v^(x)){\ + V2{y)) 

k(\u\) 



1 + A:(|m|) 



(5.140) 



max Vy2(y)g(«f,x, y) < -2 ^'f' + Vi(x) (5.141) 

deD 1 + V2(y) 

It is clear that the subsystem y — gid,x, y) does not necessarily satisfy the ISS 
property from the input x e SH" . Consequently, the classical small-gain theorem in 
[21] cannot be applied because the j-subsystem in (5.139) is not ISS but integral 
ISS with X e 9i" as input. Recent small-gain approaches have been used for sys- 
tem (5.139), where it is shown that e !){" x Dt* is Globally Asymptotically Stable 
(see [1, 15-18]) for the disturbance-free case with a — 0. Here we will show, by 
making use of Theorem 5.4, that system (5.139) satisfies the UISS property from 
the input M edi'". 

Take arbitrary e e (0, 1) and define 

h(x,y):^Vi(x)--^ Wix,y):^Vi(x) + V2(y) (5.142) 

2 — e 

Inequalities (5.140), (5.141) guarantee that if h(x, y) > 0, then inequalities (5.84), 
(5.85) hold with Sis) = e, K(s) = 1, and ^(s) = 0. Using (5.140), (5.141), (5.142), 
and the inequality s + w < max{(l + fi)s, (1 -t- fi~^)w}, which holds for all /Lt > 0, 
s,w>0, we can prove that, for all X e (0, 1) and /x > with /x > jzr;^- and s e (0, 1) 

with e < ^E^, the following implications hold: 



Vi(x) > max 



(l+fl)(l+/x) V2(y) ,,, ,. 

2 + a-k l + V2(y) ^ ' 



^ miixVVi(x)f(d,x,y,u)<-p(Vi(x)) (5.143) 

deD 

V2{y)> ^ ' ' , and h{x,y)<0 
2 — k — Viix) 

^ miixVV2{y)g{d,x,y)<-p{V2{y)) (5.144) 

deD ^ ' 
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where p(s) :— j^. Therefore, implications (5.86) hold with ^(s) :— A:(|m|), 
yiAs) = K2,2(.0 - 0, yu2(s) := (-1^^^, y^^s) := j^Jor s e [0, i±f ], 
and y2,i('S) '■— iT,-2xy^o-x)E ^^^ ^ ^ sS- Finally, since Vi : !H" -^ i)}"*" and 
y2 : Dt* ^- St"'" are radially unbounded, positive definite functions, it follows that 
inequality (5.83) holds for appropriate functions ai,a2& Koo (Proposition 2.2). 

It follows from Theorem 5.4 that system (5.139) satisfies the UISS property from 
the input u e iH'", provided that the small-gain inequalities hold. In this case the 
small-gain inequalities are equivalent to the following inequality: 
(1 - a)(l +iJ.)<{2-X){2 + a-X) 

Since a e [0, 1], the above inequality as well as the inequality /x > ^z^T holds for 

At- 3, A- J. 

The following example deals with the robust global sampled-data stabilization of 
a nonlinear planar system and shows how Theorem 5.1 can be applied to systems 
with variable sampling partition. 

Example 5.4.4 Consider the following planar system: 

y^ fix) + g{x)y + u 

ix,y)em^,uem (5.145) 

where f,g:di—^dl are locally Lipschitz functions with /(O) — 0. We will show 
that there exist a sufficiently large constant M > and a sufficiently small constant 
r > 0, so that system (5. 145) in closed loop with the feedback law u — —My applied 
with zero order hold, i.e., the closed-loop system 

Mt)^-{l + yHt))x(t) + y(t) 

y(t) = -Myin) + f{x(t)) +g{x(t))y(t) t e [t;, t,+i) 

T;+i = Tj + exp(-w(r;))r, w(t) e !){"^ (5.146) 

satisfies the UISS property with zero gain when w is considered as input. 

First, notice that there exists a function a e KL such that, for all {xq, y) e di" x 
£~ (Dt"""; di), the solution of i = -(1 + y^)x + y with initial condition x(0) = 
XQ corresponding to inputs y e C'^QM'^; !W) satisfies the following estimate for all 
?>0: 

|x(f)| <max{CT(|xo|,f), sup y(|y(r)|)| (5.147) 

' 0<T<f ' 

with y(s) :— / . Indeed, inequality (5.147) can be verified by using the Lya- 

punov function V(x) — x^ which satisfies the following implication: 

9 2y2 .1 

lfV(x)^x^> ^, theny< — V(x) 

1 + 4y^ 4 

The above implication, in conjunction with Lemma 2.14 in Chap. 2, guarantees that 
(5.147) holds for appropriate a e KL. Next, we show the following claim. 
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Claim For all E,a > 0, there exist a e KL, sufficiently large M > 0, and sufficiently 
small r > such that for every (yo,x,w)e !H x /:^^.(S){+; B[0, a]) x C'^^id^'^; dl+), 
the solution of 

y{t) = -My(xi) + f{x(t)) + g{x(t))y(t), t e [r;, t,+i) 

T,+i = r,- + exp(-w(r,))r, w(t) e m+ (5.148) 

with initial condition y(0) — yo corresponding to inputs (x, w) e £j^^,(9i"'~; 
B[0, a]) X £J^^(9J"'~; DJ"*") satisfies the following inequality: 

\y(t)\<mixx\a{\yo\,t),E sup|x(r)|| (5.149) 

Proof of the Claim Let £, a > be arbitrary. Since f,g:di—^^ are locally Lips- 
chitz functions with /(O) — 0, there exist constants P, Q > such that 

\f(x)\<P\x\ and \gix)\ < Q for all x e 5[0, a] (5.150) 

Let M > and r > be chosen so that 

9p2 

M>2 + 2Q+^ and 3(M + Q)r exp(Qr) < I (5.151) 

Consider a solution y(t) of (5.148) corresponding to arbitrary (x,w) e 
/:~ (9t+; B[0,a]) x /I^e^^"^- ^"^) ^i* initial condition y(0) = }'o e Sli. There 
exists a maximal existence time for the solution denoted by fmax < +cxd. More- 
over, let 7T :— {to, ti, . . .} be the set of sampling times (which may be finite if 
'max < +oo), and mp{t) :— max{r e n : r < t). Let ||x|| :— supQ<^<, \x(s)\ and 
r — mpit). Inequalities (5.150), (5.151) and the fact that t — x <r,m conjunction 
with the Gronwall-Bellman inequality, implies 

I rA . .1^ (M+0rexp(er) , ^^^| 

\y{t)-y{r)\ <- — 77V\\y^^n 

' ' 1- (M+ 2)'"exp(Qr)' ' 

+ ''- exp(er)||jc|| (5.152) 

l-(M+e)rexp(er) 

Define V{t) — y^{t) on [0, Wx)- Let / C [0, fmax) be the zero Lebesgue mea- 
sure set where y{t) is not differentiable or where y{t) ^ —My(xi) + f(x{t)) + 
g(x{t))yit)). Using (5.150), (5.151), and (5.152), we obtain, for all t e [0, fmax)\/, 



e 



2 



||2 



V<-2V(t) + —\\xt for all f e [0, Wx)\/ (5.153) 

Directintegrationof the differential inequality (5.153) and the fact that V(t) — y^(t) 
give 

|y(f)| <max{V2exp(-Ol3'o|,e|kll} for all f e [0, fmax) (5.154) 

Clearly, inequality (5.154) implies that as long as the solution of (5.148) exists, 
y(t) is bounded. A standard contradiction argument, in conjunction with the BIC 
property for (5.148), implies that fmax — +oo. Inequality (5.149) is a direct conse- 
quence of (5. 154). The proof is complete. D 
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We select M > sufficiently large and r > sufficiently small such that inequal- 
ity (5.149) holds with e < 1/V2 and a — 1 + V2/2. The solution of the closed-loop 
system (5.146) exists for all f > 0. The existence of the solution is gutiranteed by 
the following claim. 

Claim For all M > 0, r > 0, and (yo, xq, w) e !){ x Sit" x /:i~ (!){+; !){+), the solu- 
tion o/(5.146) with initial condition (x(0), >'(0)) = (xq, yo) corresponding to input 
w e £^^,(9^"*"; Ot"*") exists for all t >0. Moreover, for M > sufficiently large and 
r > sufficiently small, there exist A e Kqo and ^ E tt such that 

\x(t)\ + \y(t)\<A{\ixQ,yQ)\) for all t e [0, ^] (5.155) 

\xit)\<a forallt>^ (5.156) 

^ < I + r + A{\xo\) (5.157) 

where a = 1 + v2/2. 

Proof of the Claim Let M > 0, r > 0, and (yo, xq, w) e 9t x Dt" x C^^i^^"^; at+) be 
arbitrary. Consider a solution {x(t), y(t)) of (5.146) corresponding to arbitrary w e 
£^^(9J+; 9J+) with initial condition (x(0), yiO)) — (xq, yo). Denote by Wx < +oo 
the maximal existence time for the solution. Moreover, let jr :— {tq, ri, . . .} be the 
set of sampling times (which may be finite if rmax < +oo), and mp(t) :— maxjr e 
7T :r <t}.By virtue of (5.147), we have, for all t e [0, fmax), 

|x(r)| <max{cr(|xo|,0),fl} (5.158) 

Define 

P :— max{|/(x)| : |x| < max{a(|xo|, O), a}} and 

(5.159) 
Q :=max{|g(x)| : |x| < max{cr(|xo|, O), a}} 

Using (5.158), (5.159) in conjunction with Gronwall-Bellman's lemma, we obtain 
the following inequality for all t e [0, fmax): 

\y(t)\ < |y(T)| exp((M + 2Q)(t - r)) + Pit - r)exp(e(f - r)) (5.160) 

where t = mp(t). Using (5.160) and by induction, we can show the following in- 
equality for all T, e JT : 

\y(ri)\ < |>'o|exp((M + 20r,) + Pr,exp(er)exp((M + 2e)r,) (5.161) 

where we have used the fact that r,-|_i — r, < r. Estimate (5.160), in conjunction 
with (5.161), gives, for all t e [0, ^max), 

|>'(0|<[l3'Ql + -Pfexp(er)]exp((M + 2G)f) (5.162) 

A standard contradiction argument, in conjunction with the BIC property for (5. 146), 
implies that fmax — +oo. 

The existence of ^ e tt such that (5.156) holds is a direct consequence of (5. 147) 

and definitions y(i) :— / , a — I + V2/2. By virtue of Theorem 3.1 in 

Vl+4i- 

Chap. 3, there exists p e Koo such that 

^<l + r + p{\xo\) (5.163) 
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Finally, let M > be sufficiently large and r > sufficiently small so that (5.149) 
holds for fl = 1 + V2/2 and e < l/\/2. For xq e f){" with ct(|xq|, 0) < a, we obtain 
from (5.147) and (5.149), for all t > 0, 

\x(t)\ + \y(t)\<{2 + E + 2/V3){a{\xo\,0)+a{\yo\,0)) (5.164) 

Using (5.158), (5.159), (5.162), (5.163), and (5.164), we guarantee the existence of 
P e Koo such that 

\x{t)\ + \y{t)\<p{\(xo,yo)\) for all f e [0, ?] (5.165) 

The existence of A e ^00 satisfying (5.155) and (5.157) is a direct consequence 
of (5.163) and (5.165). The proof is complete. D 

The fact that the robust global stabilization problem for (5.146) with sampled- 
data feedback applied with zero-order hold is solvable with M > being sufficiently 
large and r > being sufficiently small is a consequence from all the above and 
Theorem 5.1. Indeed, we apply Theorem 5.1 with n — 2, Vi — \x\, V2 — \y\, L — 
\x\ + \y\, H = (x, y), S{t) := {(x, y) e SH x Di : \x\ < a], Yi.iis) := ^s, Y2,i{s) := 
ss, yi.i = 0, 72,2 = 0,l; = Q,g"=0,r] = Q,i) = 0,p'-'= 0, cit) = c(t) = v(t) = 
li{t) — K{t) = 1 + r, g = 0, and p{s, w) :— s + w for appropriate a,b e Koo, o e 
KL, and q e A/2. All Hypotheses (SGl-3) are satisfied by using the above definitions 
and previous results. Therefore, we conclude that the closed-loop system (5.146) 
with M > being sufficiently large and r > being sufficiently small satisfies the 
UISS property from the input w with zero gain. 

The following example is a large-scale system and shows how efficiently the 
small-gain results of the present work can be applied to large-scale systems. 

Example 5.4.5 Consider the following system described by ODEs: 

Xi(t)^-aiXi(t) + gi{d(t),y{t),x(t)) i^l,...,n (5.166) 

y(^t)^-{c+P{x(t)))y(t) + q{x(t)) (5.167) 

where x(f) = (xi(0, . . . , x„(0) e di'\ y(t) e di, d(t) e Z) c f)f", D c di"' is com- 
pact, fl; > (i = 1, . . . , n), <w > 0, and gr- D x di x di" ^ di (i ^l,..., n), 
P '.W —>■ St"*", and ^ : 9i" ^- Dt are locally Lipschitz mappings with ^(0) = for 
which there exist constants A e (0, 1), c, , > (/, 7 = 1 , . . . , n), and R > such that 

\q(x) 



kQ}+ P(x) 



<R forallxeS){" (5.168) 



sup\gi{d,y,x)\< max Cij\xj\ for all x e SH" and y e *){ with | y | < ^ (5.169) 

deD ,/'=l,...,n 

Moreover, we assume that there exists a nondecreasing function L : di~^ —>■ ^H"*" such 
that 

sup[xigi(d,y,x)]<L{\y\){l + \x\^) / = !,...,« (5.170) 

deD 

for all X, z e d\" and y e dt 
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We will next show that system (5.166), (5.167) is URGAS if c,,, < a, for all 
i — I, . . . ,n and the following small-gain conditions hold for each r — 2, . . . ,n: 

for all ij e [I, . . . , «}, i j ^ ik if j ^ k. 

Define the family of functions Vi{x, y) :— jxf {i — 1, . . . , n), V„+i(x, 3;) :— 
\y^, W{x, y) := 1 + \\x\^ + \y^, and h{x, y) ;= y'^ - R^ for (x, y) e di" x 9J. 
By direct computation, 

yy<-{a,+ P(x))y^+\h(x)\\y\ 

< R{Xco + Pix))\y\ - (Xco + Pix))\y\^ - co(l - X)\y\'^ 
^-\y\{kco+P(x)){\y\-R)-co(l-X)\y\^ 

Itthenimplies that inequality (5.84) holds S{s) = 2co(l — X) R^ . Moreover, by virtue 
of (5.170) and the above inequality, we obtain 



yW{x,y) 



L{\y\){l + \x\^) 



Consequently inequality (5.85) holds with Kis) := 2L(v'7+~R2). Inequality (5.83) 

2 2 

holds with a[(s) :— f — - and a2(s) :— y. Finally, notice that, for all /x e (0, 1) 

and i — I, . . . ,n, the following implication holds: 

Vi(x)>—^\gi{d,y,x)\^ 



Xi[-aiXi + gi{d,y,x)) < -(1 - /x)a,x,. (5.172) 



It follows from (5.172) and (5.169) that implications (5.86) for / — I, .. . ,n hold 
with 

cf. 
Pi(s) := 2(1 - /x)a/5 Yi,j(s) := —^s and y;,„+i(i) := 

for .J >0 and/, J = !,...,« (5.173) 

Since q : SH" -^ di is a continuous mapping with q (0) — 0, it follows that there exists 
a function y e Koc such that the following inequality holds: 

\qix)\<Y{\x\) for all X est" (5.174) 

Inequahty (5.174) and the fact that P(x)>Ofor all x e i){" (notice that P : ilf -^ 
di'^) imply that the following implication holds for every /x e (0, 1): 

V„.t(,)>^(K(W)f 

^ y[-{a,+ P(x))y + q(x)]<-{l-ii)ajy^ (5.175) 

It follows from (5.175) that implication (5.86) holds for i — n + I with 
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1 2 

Yn+ijis):^ —^^—j{y{^2ns)) and y„+i,„+i(j) := 

fori >0 and ;•= !,...,« (5.176) 

Definitions (5.173) and (5.176), in conjunction with (5.171) and the fact that 
c, , < Oj for all i = 1, ...,n, guarantee that there exists /x e (0, 1) (sufficiently 
close to 1) such that the MAX-preserving mapping F : ^W^^ —^ dV^^ with r{x) — 
(Fiix), ..., r„_(_i(x))', Fjix) — max,-^i. ._„_)_i Yijixj) for all x e ^i'^ and / — 
1, . . . , n + 1 satisfies the cyclic small-gain conditions. It follows from Theorem 5.4 
that system (5.166), (5.167) is URGAS. 
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Games 

Consider a strategic game with n players and Si c J){*^' (i — 1, . . . ,n) being the 
action space for each one of the players. We assume that the best reply mapping for 
each player is a function f, : Si x ■ ■ ■ x Si-\ x Si+i x ■ ■ ■ x S„ ^ S, for 1 < / < 
n, n >3, and /i : ^2 x ■ ■ ■ x 5'„ ^^ 5i, /„ : 5*1 x ■ ■ ■ x 5„_i -^ S„, satisfying the 
following inequalities: 

^i iqi ,q-i) < ^i (fi iq-i ),q-i) 

for all qi e Si with qi ^ fi(q-i), i — 1, . . . ,n (5.177) 

where jt, {qi , q-i ) is the payoff function of the ith player. We assume the existence 
of a Nash equilibrium q* e S for the game, where S :— Si x ■ ■ ■ x S„ is the outcome 
space for the game, i.e., there exists q* — (^p . . . , q*) e S such that 

q* = fi{qli) / = 1,...,« (5.178) 

The existence of a Nash equilibrium can be guaranteed by Brouwer's fixed point 
theorem when all action spaces 5*, c SH*^' (/ — 1, . . . , n) are compact and convex 
and when all the best reply mappings fi : Si x ■ ■ ■ x Si-i x Si+i x • • • x 5„ ^- 5; 
for 1 < / < M, n > 3, and /i : 52 x ■ ■ ■ x S',, ^^ ^i , /„ : 5*1 x ■ ■ ■ x 5„_i -^ Sn are 
continuous mappings. 

Next, we assume that Si c *){*^' (i — 1, . . . , n) are closed convex sets and that the 
dynamics of the game are described in continuous time as follows: 

• every player forms an expectation for the behavior of all other players at each 
time f > 0: the expectation of the ith player for the production level of the yth 
player at time f > will be denoted by qfj(t) e Sj {j ^ i, i, j — 1, . . . , n), 

• every player determines her action as a convex combination of a past action and 
the best reply response based on the expectations for the behavior of all other 
players at each time r > 0, i.e.. 
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qiit) = 0i(r)Pr5, [q,[t - Ti(f))) + (1 - 0l(f))/l(?i;|(O, . . . , qT^n^t)) 

qiit)^6i{t)¥xs,{q,{t-ri{t))) 

(5 179) 

qnit) = 0„(f)Prs„(^„(f - T„(f))) + (1 - 0„(f))/„(^„7(f), . . . , C^-i^^)) 

where 0, : M+ ^^ [0, 0], r, : Sit"*" ^^ {r,T'\, i — I, . . . ,n, are in general unknown 
functions, and < < 1 and < r <T are constants (in general unknown), 
• all expectation rules q'^^fit) e Sj (j ^i, i — I, . . . ,n) are Consistent Backward- 
looking expectations (see Example 1.4.1 in Chap. 1) with respect to the Nash 
equilibrium point q* e S, i.e., there exist constants < T < r such that, 
for all t > 0, 

k,7(0-9*|< sup \qi(r)-q*\^\\qi-q*L_,,_r^ (5.180) 
t-r<T<t-T . L , J 

Notice the following fact for consistent backward-looking expectations: 

Fact Suppose that Sj c i)rj is a closed convex set. q^ J it) {J ^ i, i, j — \, . . . ,n) 
is a Consistent Backward-looking expectation with respect to the Nash equilibrium 
point q* e S if and only if there exist constants < T <r and a function dtj : 
9{+ ^ [de m'^J ■.\d\<l} such that 

qtj(t)^Prs^iq*+dij{t)\\qj-q*l,_^.^_^^) forallt>0 (5.181) 

Proof of Fact Indeed, using the fact that |Prf/(x) — Pru(y)\ 'S \x — y\ for every 
X, y e di", where U c J){" is a closed convex set, one can verify that for every 
dij : m+ -^ {d€ m''J : \d\ < 1}, the function q'^Jit) defined by (5.181) satisfies 

(5.180) and qf^f{t) € Sj for all f > 0. Hence it is a Consistent Backward-looking 
expectation with respect to the Nash equilibrium point q* e S. On the other hand, if 
q^^f{t) e Sj is a Consistent Backward-looking expectation with respect to the Nash 
equilibrium point q* e S satisfying (5.180) for all f > 0, then the function defined 
by 

di j (t) = r, 4 (?r?(0 - q*) if Ik; - q* II r, , ri > 

di,j(t)^0 if lk,/-?*||[,_,.,_7-]=0 

satisfies dij(t) e {d e di'^J : \d\ < 1}. Moreover, (5.181) holds for all t > 0. 

The proof is complete. D 

The above fact shows that if all action spaces Sj c ^i'^i (j — 1, . . . ,n) are closed 
convex sets, then there exist constants O<r<r,O<0<l and functions 9i : 

m+ -^ [0, 0], T/ : m+ -^ [T, r], and d^j : m+ ^ {d e 'M'^j : \d\ < 1} (j / /, /, ; = 
1, . . . , m) such that 
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qiit) ^ eiit)PTSi{qi{t - ri{t))) 

+ (1 - 0,{t))fi{PvsM + dl,2(t)\\q2 - ?2ll[,-,,,-r])' • ■ ■ ' 
Pl-5,, (?„* + dun (t) II qn - q* \\ y_,j_T])) 
: (5.182) 

q„ (t) = e„ (OPrs„ {q„ {t - r„ (t))) 

+ (l-^H(0)./«(Pr5i(?;'+4i,i(0|ki-?i*||[,_,.,_7-]),---, 

Pr5„_i(?^-l +'in,«-i(0|k«-i -?„*-! II [,_^_,_r])) 

In general, the constants O<r<r,O<0<l and the functions (9, : S1{+ —!^ [0, 0], 
r/ : m+ -^ [T, r], and di^j : !H+ ^ {d e m'^J : \d\ < 1} (; ^i,i, j ^ I, . . . ,n) are un- 
known. Therefore, the dynamical system (5.182) is an uncertain dynamical system 
described by Functional Difference Equations (FDEs). In order to study the behav- 
ior of the solutions of (5. 1 82), we define the deviation variables x,- (f ) = qj (t) — qf 
{i — \, . . . , n), and from (5.182) we obtain 

XI (f ) = di (t) (Pr5, (xi (f - ri (f )) + ql) -q*) 

+ (1 - 0lit)){fl{PlS2iq2+dl,2(t)\\X2\\[t-r,,-T]), ■■■, 
Prs„iqn + dl,n(f)\\Xn\\lt-r,t-T])) - ?0 

: (5.183) 

Xn (t) ^0„(t) {Prs„ (x„ [t - r„ (r)) + q*) - q*) 

+ (I - 0nit))(fn{Prs,{qi + d„^l{t)\\xi\\[,-rJ-T]), ■ ■ ■ , 

Pr5'„_,(?*_i +4,,«-i(0lk«-ill[f-r.f-r])) -?,t) 
Finally, we assume that there exist functions y, ^ e M (j y^ i , i , j — I , . . . , n) such 
that the following inequalities hold for a\lq e S: 

\fi{q-i)-q*\<miixyi^j{\qj-q*\) i^l,...,n (5.184) 

Using again the fact that |Prc/(x) — Pru(y)\ < \x — y\ for every x, y e M", where 
U c J1{" is a closed convex set, and inequalities (5.184), we obtain from (5.183), for 
all f > 0, /x > 0, and i — I, . . . ,n. 



\xi(t)\ < max 



fi — 110 I , 1 

Mlk/lkr-z-.r-rj-max -—Yi^j[^Xj\t-r,t-T\) \ (5.185) 

./¥'■ ii — V) ' J 



Remarks and Examples about systems (5.182), (5.183) 

(a) It is worth noting that system (5.183) is an infinite-dimensional dynamical sys- 
tem with state space X being the normed linear space of bounded functions x : 

[—r, 0] —^ ''M^ , where N — ki + \- k,, with norm ||x||;f — sup_^<j.<o k(T)|. 

It is described by FDEs and satisfies Hypotheses (Ql), (Q2) of Sect. 1.2.4 in 
Chap. 1. The Dynamic Cournot oligopoly game (Example 1.4.1 in Chap. 1) 
satisfies all above hypotheses. 
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(b) The equilibrium point e A" of system (5.183) corresponds to the Nash equi- 
librium point q* e S, noting that the deviation variables have been defined by 
Xi (t) — qi (t) — q* for i — I ,..., n . 

(c) All discrete-time models of the form 

qi{k+l)^0i(k)qi{k)+{l-9i(k))fiiql"^(k+l),...,ql'^^^ik+l)) 



qi(k+l)^9i(k)q^(k) + {l-ei(k)) 



x/,(g,f7(A:+l),.. 


■■^^(^ +!)-€+! 


(k 


C(^+i)) 






Uk)qn(k) + {1 - e, 


r(k))fniq!^!(k+l),. 





I),..., (5.186) 



qn(k + 1) = en{k)qn{k) + (l - 0„(fe))/„(^,ta (^ + D, ■ ■ ■ , ^^-1^^ + ^'^) 
with 

m 
q.^J{k + 1) = aij(k) ^ Wijj(k)qj{k - /) + (l - aijik))q* (5.187) 
/=0 

where k, m are nonnegative integers, aij(k) e [0, 1] (/, j — 1, . . . , n), 6i(k) e 
[0, 0] (i = 1, . . . , n) with e [0, 1), 'w,-,,-,/(jt) > with 1 = J^'iLo ^i.jjik) 
for all ^ > and I — 0, ... ,m (i, j = 1, . . . ,n), are included in the uncertain 
model (5.182) and its equivalent expression (5.183) in the sense that for every 
model of the form (5.186), (5.187), one can give functions Oj : S){+ —>■ [0, 0], 
Xi : m+ -^ [T, r], and rf,-,,- : 9t+ ^ {d e m'^J : \d\ < 1} {j ^ i, !, ; = 1, . . . , n) 
such that the solution of (5.182) coincides with the solution obtained by the 
discrete-time model (5.186), (5.187). 
(d) Similarly, as shown in Example 1.4.1, if Sj c [0, +oo) for all y = 1, . . . , n and 
if all expectation rules q^'J{t) (j ^i,i, j — I, . . . ,n) are Consistent Backward- 
looking expectations with respect to the Nash equilibrium point q* e S and 
all mappings t -^ q^'^j'it) (j ^ i, i, j — I, . . . ,n) are continuous, then all 
continuous-time models 

qi(t) = Ml (/l (qlait), ..., q^'^^iO) - qiiO) 



qnit) = M«(/Hfeu (f)' ■ ■ ■ ' C«-i(^)) - *'('^) 

where /i, > are constants, are included in the uncertain model (5.182). 
(e) The reader should notice that no continuity assumption is made for the best reply 
mappings of the players // : ^i x ■ ■ ■ x Sj-i x Si+i x ■■■ x S^ ^ Sj for 1 < i < 
«, n > 3, and /i : 52 x ■ ■ ■ x S',, ^^ 5'i, /„ : 5*1 x ■ ■ ■ x Sn-i -^ Sn- Moreover, we 
have not assumed that the action spaces Sj c 'Si'^J (j — I, . . . ,n) are compact 
sets: we simply require that the action spaces are closed convex sets. However, 
we have assumed the existence of a Nash equilibrium point q* e S and the 
existence of functions yij eN (j ^i,i — I, . . ., n) satisfying (5.184). 
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The crucial question that can be posed is the question of robust asymptotic stabil- 
ity of the Nash equilibrium q* e S for system (5 . 1 82) or equivalently the question of 
robust asymptotic stability of e X for system (5.183). The following theorem is an 
application of Theorem 5.2 and shows that robust global stability can be determined 
by the functions yij eJ\f(j^i,i — l,..., n) satisfying (5.184). 

Theorem 5.7 & X is Robustly Globally Asymptotically Stable for system (5.183), 
if there exists a; > 1 such that the following set of conditions holds for each p — 
2, . . . ,n: 

iYii,i2 ° Y'lJi ° ■ ■ ■ ° K'p,'i)('^) < ^ for all s>Q (5.188) 

for all ij e {1, . . . , n], ij ^ i^ if j ^ k, where yij(s) :— coyijicos). 

In other words, if conditions (5.188) hold, then the Nash equilibrium point g* e S 
is robustly globally asymptotically stable with respect to all possible Consistent 
Backward-looking expectation rules with respect to the Nash equilibrium point 
q*eS. 

It should be noticed that for the Cournot oligopoly game studied in Exam- 
ple 1.4.1, the best reply mappings /,- (i — 1, . . . ,n) are defined by (1.45). Conse- 
quently, using the convexity of the sets 5, — [0, Qi] (i — I, . . . , n), we obtain the 
following inequalities for / = !,...,«: 

/, I, 

\ r /- \ * I ^ \ ^ I =i< I ^ / 1 \ I * I 

fi(q-i) — q: \ < > \q i — q i\ < (n — l)max o; — a :\ 

The above inequalities imply that inequalities (5.188) hold with yij(s) :— 
Ri(n — l)s, where Ri :— 2h+K • Theorem 5.7 and the above definitions guaran- 
tee robust global asymptotic stability of the Nash equilibrium, provided that there 
exists o) > 1 such that the following set of conditions holds for each p — 2, . . . ,n: 

Ri,Ri^---Ri^{n-l)Po?P <\ 

for all i j e {1, . . . , «}, ij ^ ij^ if j ^ k. The conditions 

Ri,Ri^---Ri^,{n-\)P <\ forall// e{l,...,n}, ij^ikifj^k (5.189) 

are necessary and sufficient conditions for the existence of a (sufficiently small) 
constant w > 1 satisfying the above inequalities for each p — 2, . . . ,n and for all 
(/ e{\, . . . ,n], ij ^ ik'if j ^k. A more careful analysis similar to the above anal- 
ysis reveals that the Nash equilibrium for the Cournot oligopoly game described in 
Sect. 5.2 will be asymptotically stable, provided that there exist n sets of positive 
real numbers A,- — {a,,/, j ^ /} (i — 1, . . . , n) with ^ ,j/ Xj < maxj^jiajjxj) for 
all jc = (xi , . . . , jc„)' e (di~^)" and i — !,...,« such that the following set of condi- 
tions holds for each p — 2, . . . ,n: 

^11,12^12,1^ ' ' ' ^//j,/] ^/] '^12 ' ' ' ^ip ^ ^ 

for all !/ e {1, . . . , n}, ij ^ ij; if j ^ k. The above conditions are less restrictive than 
conditions (5.189); indeed, conditions (5.189) are implied by the above conditions 
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for the special case a, j —n — \ for dXli, j — !,...,« with j ^i. For example, for 
n — T), the above small-gain conditions are equivalent to the existence of £ i , £2 , £3 > 
such that 

7?i7?2(l + ei)(l + e2)<l 
7?i7?3(l + £r^)(l + £3)<l 
7?2«3(l + e^^)(l+e3"')<l 
RiRiR^d + ei)(l + e2"')(l + £3) < 1 
7?i/?2^3(l + er')(l + e2)(l + £3"') < 1 

For the above inequalities, we have used ai 2 = l+£i,ai,3=l + £j~ ,02, 1 = 1 + £2, 
02,3 = 1 + £2" ' ^^3,1 = 1 + £3j 3nd (332 = 1 + £^ .By selecting £1 = £2 = £3 = 1, 
we obtain inequalities (5.189). 

It should be emphasized that the parameters r > T > 0, which are involved in 
the Consistent Backward-looking expectations, play no role in the small-gain con- 
ditions. Consequently, the small-gain conditions can help us to decide whether the 
Nash equilibrium point is robustly stable without any knowledge of the expectation 
rules. The small-gain conditions (5.188) demand knowledge of the Nash equilib- 
rium point q* e S and the best reply mappings /, : ^i x ■ ■ ■ x S/_i x Si+i x ■ ■ ■ x 
S„ — ^ Si for 1 </<«,« > 3, and /i : 52 x ■ ■ ■ x 5„ ^ ^i, /„ : 5i x ■ ■ ■ x S„-\ -^ S„ 
for which inequalities (5.184) hold. 

Proof of Theorem 5.7 We first notice that system (5.183) is an autonomous dy- 
namical system. By virtue of Theorem 1 .2, e <¥ is a robust equilibrium point for 
system (5.183). 

Let CT > and define the family of functionals Vj : X —>■ Sit"*", i — I, . . . ,n,hy 

Vi(x)— sup |x/(r)| exp(CTr) (5.190) 

-/•<T<0 

Using definition (5.190) and (5.185), we obtain, for all h e (0, T), / = 1, . . . , n, 
fi> 0, and t >0, 

Vi{xt+h) 

— sup |x,(f -I- /; -I- r)| exp(crT) 

-/•<r<0 

— sup \xi(s)\exp(o'(s — t — h)j 

t+h-r<s<t+h 

< max! sup \xi{s)\&x\i{a{s — t — h)), sup |x,(s)| exp(CT(i' — r — /;)) ! 

'-t+h-r<s<t t<s<t+h ' 

< max|exp(— ct/i)V,(x,), sup /x||x; ||[.5_7-,.5]exp(CT(.j — r — ft)), 

I t<s<t+h 

sup max -— y;,/(||x,||[^_r,,])exp(cr(5 -r-ft)) \ 

t<.'i<t+h JT^i iJ^-k) ' J 
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= maxj exp{—ah)Vi{xt), 

sup (U, sup |jc,(i(; + s)| exp(aM;)exp(— CTi(;)exp(CT(.? — r — /;)), 

t<s<t+h -r<w<0 

fl — 110 / I I \ 

sup max Yi,j\ sup |xj(w; + i')| exp(crw)exp(— crw) 1 

t<s<t+h ./¥' IJ. — '■ ^-r<w<0 ' 



X exp(o-(5 — t — h'))\ 



< max|exp(— cr/2)V,(x,), sup /xexp(crr)V,(x5), 

I f<i<r+/i 

[I — [i@ I . 1 

sup max — Yi. / (exp(CTr) Vj fc)j [ 

t<s<t+h i#' M — c' J 

< max|exp(— ct/z)V/(x,), /xexp(ar) sup y,fe)> 

/X — 110 / 

max —-Yijiexpiar) sup V/fc) 

JT^i //. - fe' V t<s<t+h 

where (x^)(r) = x(r) for t — r < r < t. Consequently, for all / = 1, ...,«, cr > 0, 
he{Q,T), fi> 0, and f > 0, it holds that 



=(. 



V,(xr+ft) <maxjexp(-CT/!)V,(x,),/iexp(CTr) sup V/fc), 

I t<s<t+h 

fl — tl0 ( \ 1 

max -— y/,/(exp(CTr) sup V;/(x.,))[ (5.191) 

j+i 11-0 V r<i<r+/2 ^ J 

Using induction and (5.191), we can show that, for all / = 1, . . . , n, ct > 0, /z e 
(0, r), II > 0, and f > and for every nonnegative integer ^ > 0, it holds that 



V,(x,+ift) <max 



exp(— CTA;/z)V,(Xf), /xexp(CTr) sup Vi(xj), 

t<s<t+kh 



II — 110 

max -— y, 

,/// /x - 



,/(exp(ar) sup ^/(x,)) (5.192) 



Therefore, (5.192) implies that, for all i = 1, . . . , m, /Lt > 0, cr > 0, and f > 0, the 
following inequality holds: 



Vi(xr) < max 



exp(— af)V,(xo), /Ltexp(crr) sup V,(x.5), 

0<s<f 



11 — 110 _ 

max Yi 

j^i 11-0 



,y(exp(ar) sup y,(x,))l (5.193) 

^ 0<s<t ' J 
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Notice that definition (5.190) implies that 2Vi (x,) > sup_^<^<o \^i (^ + ^)l for cr < 
r~^ In (2) and, consequently, 

n n 

\\xt\\x=\\x\\[t-r,n<Y^ sup \xi(t + r)\<2^Vi(xt) (5.194) 
,=1 -'■^^^0 ,=1 

Without loss of generality we may assume > 0. Define /x :— ^^^0 and let 
the constant ct > satisfy the inequalities a < r~Mn(2), a < r~'ln((w), and 
cr < r~^ In C""^^" ), where o) > 1 is the constant involved in the hypotheses of 
the theorem. Notice that the hypothesis < I and previous definitions imply that 
/iexp(ar) < 1, /x > 0, exp(crr) < a>, and ^^—^ < a>. It follows from (5.193), 
(5.194), and definition (5.190) (which implies Vi(xt) < ||xr||;f) that the following 
inequalities hold for all ; = 1, . . . , n and f > 0: 

Vi{xt)<max[exp{—(jt)L{xQ),B sup V,(x.s), max&)j//,jf&) sup ^^/(xs))! 
^ 0<i<r JT^i ' ^ o<s<t ' ' ' 

I 

in n 

\y maxftiy,- y(ft) sup V'/(x.s) j + 2B 2, sup V,(x 

(5.196) 



l^{x.t) < max< 2m||j:o||a'> 2 




where L(x) \— \x\x and B :— fiexpiar) < 1. It follows from (5.194), (5.195), 
(5.196), and Theorem 5.2 that e <¥ is Robustly Globally Asymptotically Sta- 
ble for system (5.183), provided that the set of conditions (5.188) holds for each 
p — 2,...,n and for all /j e {1, ...,«},// ^ ik if 7 ^ k. The proof is complete. D 

Theorem 5.7 may be used to derive conditions for uniqueness of a fixed point. 
Indeed: 

Corollary 5.4 Let Si c Sir' (( — 1, ...,n) be closed convex sets, and let func- 
tions fi : Si X ■ ■ ■ X Si-i X Si+[ X ■ ■ ■ X S„ ^ Si for I < i < n, n > 3, and 
fi : S2 X ■ ■ ■ X Sn ^>- S[, fn '■ Si X ■ ■ ■ X Sn-[ ^ Sn for which there exists 
q* — (^p . . . , q*) e S, where S :— Si x ■ ■ ■ x Sn satisfies (5.178). Furthermore, 
suppose that there exist functions Yi,j ^ A/" (j ^ /, i, j — 1, . . . , n) such that in- 
equalities (5.184) hold for all q & S and that there exists m > \ such that con- 
ditions (5.188) hold for each p — 2, . . . ,n and for all i j e {1, . . . , n}, ij ^ ik 
if j :^ k. Then q* — (q^, . . . , q*) e S is the unique fixed point of the mapping 
S3q^ F(q) := ifliq-l), ..., fn{q-n)) e S. 

It is worth noting that Corollary 5.4 does not guarantee the existence of a fixed 
point for the mapping S 3 q ^i- F(q) :— (fi(q-i), . . . , fn{q-n)) e S. Corollary 5.4 
can be used in conjunction with classical fixed-point theorems (e.g., Brouwer's fixed 
point theorem when all action spaces Si c Jlt*^' {i — \, . . . ,n) are compact and con- 
vex and when the mapping S 3 q ^ F{q) :— (/i (q-i), ■ ■ ■ , fn iq-n)) e 5 is contin- 
uous) in order to guarantee the uniqueness of the fixed point. 
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Another issue, which is important for the economic literature, is the fact that the 
hypothesis of the consistent backward-looking expectations does not allow rational 
expectations. This point motivates the following definition for the strategic game 
described above. 

Definition 5.4 An expectation rule q^'Jit) (j ^ i, i, j — 1, . . . ,n) is called a 
Rational-Consistent Backward-looking expectation with respect to the Nash equi- 
librium point ^* e 5* if there exists a constant < r such that 

\qrf(0-q*\< sup |^,(T)-^*| = ||^,-^*|L,_^ forallf>0 (5.197) 

'■' ■' t-r<T<t ■' L , J 

Clearly, rational expectations are Rational-Consistent Backward-looking expec- 
tations with respect to the Nash equilibrium point q* e S. Moreover, a Consistent 
Backward-looking expectation is a Rational-Consistent Backward-looking expecta- 
tion with respect to the Nash equilibrium point q* e S. 

Can we consider system (5.179) where all expectation rules q'^'^fit) e Sj (j ^ i, 
i,j — l,...,n) are Rational-Consistent Backward-looking expectations with re- 
spect to the Nash equilibrium point q* e SI The key mathematical problem that 
arises in this case is whether we can obtain a well-defined dynamical system if Hy- 
potheses (Ql) and (Q2) of Sect. 1.2.4 in Chap. 1 do not hold. However, we can 
extend the analysis of the previous section under the following hypothesis: 

(H') There exist m index sets Ji C. {I, . . . ,n}, I — 1, . . . ,m, with Ji n Jj^ — for 
/ ^ k and Uz=i m -^z ~ f ^ > • ■ ■ > "! ^'^'-'^ ^^^^ ^^^ following statements hold: 

• All players with ( e /„, are using Consistent Backward-looking expectations 
with respect to the Nash equilibrium point q* e S. 

• For every k — I, . . . ,m — 1 , all players with / e Jk are using Rational- 
Consistent Backward-looking expectations, q^'J(t) e Sj if j e Ji with / > k 
and Consistent Backward-looking expectations, and q^ 'J'(t) e Sj otherwise. 

Indeed, if Hypothesis (H') holds, then system (5.179) is expressed in deviation 
variables Xi (t) = qi{t) — q* (i — 1, . . . ,n)hy the following equations: 

Xi(t) ^ 0l{t){PTSi{xi{t - n(t)) + q*) - q*) + {I - 9i(t)) 

X (/i (Pr52 fe* + ^1,2(0^1,2(0), •■•, Pr5„ fet + ^i,«(0^i,«(0)) - ?0 



Xn (t)^9n (r) (Pr5„ (x„ {t - Xn it)) + q^^) - ^*) + ( 1 - 0„ (r)) 
X (/«(Pr5i [qX + dn,\{t)Sn,\{t)), ..., 

Pi's,,-! (?n-l + dn,n-l(t)Sn,n-l(t))) - q^) 

Si jit) :— \\xj \\[t-r,t] if ' e Jk and j e Ji with / > k 
Sij(t) :— ||x2||[f-,-,f-r] if; e Jk and j e Ji with / < k 



(5.198) 
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where 6»,- : m+ -^ [0, 0], r,- : 9t+ -^ [T, r], dtj : D{+ -^ {d e m'"' : \d\ < 1} (; / i, 

Let us explain next why system (5.198) is an infinite-dimensional dynamical 
system with state space X being the normed linear space of bounded functions 
X : [—r, 0] -^ y\^ , where N — k\ + ■ ■ ■ + kn with norm \\x\\x — sup_,.<j.<Q |x(t)|. 
Indeed, by using the method of steps, given an initial condition xq e X and functions 
6>/ : Ot+ -^ [0, 0], r; : Ot+ -^ [T, r], and di,j : !H+ ^ {d e m'^J : \d\ < 1} (j ^ i, 
i, j — !,...,«), one can in principle determine from (5.198) the solution x{t) — 
(xiit), ..., xnit))' e di'" for t e (0, T] with x(r) = (jci(t), . . . , jc„(r))' = xo(t) for 
all r e [— r, 0] using the following procedure: 

Step 1: First, determine the solution jc,(r) for t e (0, T] and for all players with 
/ e /,„ that are using Consistent Backward-looking expectations with respect to the 
Nash equilibrium point q* e S. In this case, we are in a position to determine the 
components of the solution Xj{t) for j e Jm and t e (0, T] by means of (5.198). 
Furthermore, in this case inequality (5.185) holds for t e (0, T], i e 7„,, and conse- 
quently there exists a function Gm e N such that 

sup |.x,(0|<G„,(||x||[_,,o]) for/ey„, (5.199) 

fe[0,r] 

Step 2: Next, determine the solution x, (f ) for t e (0, T] and for all players with / e 
Jm-i that are using Rational-Consistent Backward-looking expectations, q^^f(t) e 
Sj if j e J,n and Consistent Backward-looking expectations, and q^^f(t) e Sj oth- 
erwise. In this case, (5.184) implies that the following inequality holds for all 
f e(0, r]: 

Ui(0| < max yi^j[\\xj\\[t-rj-T})+ max Yi,i{\\xj\\[t-rj}) (5.200) 

However, the components of the solution Xj (t) for j e /,„ and t e {0,T] have been 
determined by Step 1. Therefore, we are in a position to determine the components 
of the solution Xj (?) fory e /„,_! and? e (0, T] by means of (5.198). Using (5.199) 
and (5.200), we obtain the existence of a function G„,_i e N such that 

sup |x,(0| <G„,_i(||x||[_,.o]) for/ e y,„U7„,_i (5.201) 

?e[0,r] 

Step k (3 <k < m): We determine the solution x,- (t) for t e (0, T] and for all players 
with / e J,„+i-k that are using Rational-Consistent Backward-looking expectations, 
qf^f{t) e Sj if i e 7; with I > m + I — k and Consistent Backward-looking expec- 
tations, and q^ ■ (f) e 5*^ otherwise. In this case, (5.184) implies that the following 
inequality holds for all t e (0, T]: 

\xi(t)\< max yij(\\xj\\[,-r,t-T]) 

+ max yij{\\xi\\[t-r,t]) (5.202) 

j^i,jeJlJ>m + l—k 

However, the components of the solution Xj(t) for j e Ji with I > m + I — k and 
t e (0, r] have been determined by previous steps. Therefore, we are in a position 
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to determine the components of the solution x,(f) for j e J„,+i-k and t e (0, T] 
by means of (5.198). Moreover, by virtue of previous steps, there exists a function 
Gm+2-k e JV such that 

sup \xiit)\<Gm+2-ki\\x\\[-r,o]) for/e 1) // (5.203) 

'^[0-^] /=m+2-*,...,m 

Using (5.202) and (5.203), we obtain the existence of a function Gm+i-k e A/" such 
that 

sup |^,-(0| <Gm+i-4lkl|[-,-,o]) for/e 1) /; (5.204) 

'eW.ri l=,n + l-k,...,m 

After the completion of the m steps, we have determined all components of the 
solution Xj(t) for j = \, . . . ,n and t e (0, T]. Moreover, we have also constructed 
a function G eAf such that 

sup |x(0|<G(||x||[_,,o]) (5.205) 

te[O.T] 

Without loss of generality, we may assume that G(s) > s for all s >0. Moreover, 
by using (5.205) we may establish that e A" is a robust equilibrium point for sys- 
tem (5.198) and conclude exactly as previously in that estimates (5.194), (5.195), 
and (5.196) hold. 

The proof of the following theorem is exactly the same with the proof of the 
Theorem 5.7 and therefore is omitted. 

Theorem 5.8 E: X is Robustly Globally Asymptotically Stable for system (5.198) 
under Hypothesis (H') if there exists (o > I such that the set of conditions (5.188) 
holds for each p — 2, . . . ,n and for all if G {1, . ..,«}, ij ^ ik if j ^ k, where 
yij(s):^Myij(Ms). 

It should be emphasized that the parameters r > T > that are involved in 
the definition of the Consistent Backward-looking expectation play no role in the 
small-gain conditions. Moreover, the number m of the index sets J/ C {1, . . . , «} 
involved in Hypothesis (H') or the particular members of each index set play ab- 
solutely no role in the small-gain conditions (5.188). Furthermore, all these pa- 
rameters are allowed to change with time: there is no need to assume that these 
parameters remain constant. Consequently, the small-gain conditions can help 
us to decide whether the Nash equilibrium point is robustly stable without any 
knowledge of the expectation rules. Again, the small-gain conditions (5.188) de- 
mand knowledge of the Nash equilibrium point q* e S and the best reply map- 
pings fi : Si X ■ ■ ■ X Si-i X Si+i X ■ ■ ■ X S,, ^ Si for I < i < n, n > 3, and 
/i : 5*2 X ■ ■ ■ X 5,, ^ ^i, /„ : ^i X ■ ■ ■ X S„-\ —>■ S„ for which inequalities (5.184) 
hold. 

Finally, it should be noted that, for a specific strategic game, even less demand- 
ing hypotheses than Hypothesis (H') can be used in order to guarantee that sys- 
tem (5.179) gives an infinite-dimensional dynamical system with state space X be- 
ing the normed linear space of bounded functions x : [—r, 0] -^ di'^ , where A' — 
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ki + ■ ■ ■ + kfj with norm \\x\\x — sup_,.<^<Q |x(r)|. This can be done by exploiting 
special properties of the best reply mappings /, : Si x ■ ■ ■ x Si-i x S,+i x ■ ■ ■ x S,, ^ 
Si for I < i < n, n > 3, and fi : S2 x ■ ■ ■ x S„ ^ S\, f„ : S\ x ■ ■ ■ x S„_i -^ S„ 
(e.g., if some of the functions are independent of certain arguments). 



5.6 Historical and Bibliographical Notes 

1 . The small-gain theorem has been widely recognized as an important tool for ro- 
bustness analysis and robust controller design within the control systems com- 
munity. For instance, classical small-gain theorems [9, 52, 53] have played a 
crucial role for linear robust control of uncertain systems subject to dynamic 
uncertainties [54]. As introduced in the framework of classical small-gain, an 
essential condition for input-output stability of a feedback system is that the 
loop gain is less than one. This condition relying upon on the concept of lin- 
ear finite-gain was first relaxed by Hill [14] and then by Mareels and Hill [38] 
using the notions of monotone gain and nonlinear operators. Quickly after the 
birth of the notion of input-to-state stability (ISS) originally introduced by Son- 
tag [47], a nonlinear, generalized small-gain theorem was developed in [21]. 
This nonlinear ISS small-gain theorem differs from classical small-gain theo- 
rems and the nonlinear small-gain theorem of [14] and [38] in several aspects. 
One of them is that both internal and external stability properties are discussed 
in a single framework, while only input-output stability is addressed in previ- 
ous small-gain theorems. As demonstrated in [21] and the subsequent work of 
many others, nonlinear small-gain has led to new solutions of several challeng- 
ing problems in robust nonlinear control, such as stabilization by partial-state 
and output feedback, robust adaptive tracking, and nonlinear observers. 

2. The nonlinear small-gain theory presented in [21] has stimulated the follow-up 
research by several researchers (see [1, 4-8, 11, 15-20, 22, 25-28, 31, 37, 44, 
48,49,51]). 

Nonlinear small-gain theorems for discrete-time systems can be found in 
[23, 24]. Extensions of small-gain results were presented recently in the lit- 
erature. In [1, 15-18] less conservative small-gain conditions were presented 
for finite-dimensional systems. In [5-8, 20, 27, 28] matrix gain functions were 
used for the study of large-scale finite-dimensional systems. A nonuniform in 
time small-gain theorem for continuous-time finite-dimensional systems was 
presented in [31]. Moreover, in [25, 48] small-gain results for wide classes of 
systems were provided. The classes of systems considered in [25, 48] satisfy 
the classical "semigroup property." The first small-gain result for systems sat- 
isfying the weak semigroup property was presented in [26]. Small-gain results 
for hybrid systems satisfying the classical "semigroup property" were recently 
presented in [37]. 

3. It is of interest to note that this perspective of nonlinear small-gain has found 
useful applications in monotone systems, an important class of systems in math- 
ematical biology (see [2, 10]). 
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4. One of the most important obstacles in applying nonlinear small-gain results is 
the representation of the original composite system as the feedback interconnec- 
tion of subsystems which satisfy the Input-to-Output Stability (lOS) property. 
More specifically, sometimes the subsystems do not satisfy the lOS property: 
there is a transient period after which the solution enters a certain region of 
the state space. Within this region of the state space, the subsystems satisfy 
the small-gain requirements. In other words, the essential inequalities, utilized 
by small-gain results in order to prove stability properties, do not hold for all 
times: this feature excludes almost all available small-gain results from possi- 
ble application. Particularly, this feature is important in systems of Mathemati- 
cal Biology and Population Dynamics. Indeed, the idea of developing stability 
results which utilize certain Lyapunov-like conditions after an initial transient 
period was used in [30, 34] with primary motivation from addressing robust 
feedback stabilization problems for certain chemostat models. Small-gain re- 
sults presented in this chapter can allow a transient period during which the 
solutions do not satisfy the lOS inequalities. The obtained results are direct ex- 
tensions of the recent vector small-gain result in [27], and if the initial transient 
vanishes, then the results coincide with Theorem 3.1 in [27]. Notice that the 
small-gain results presented here are included in [28]. To better position the 
generality of the small-gain results of this chapter, some highlights are given 
below. 

• They can be applied to systems that satisfy the weak semigroup property 
instead of the classical semigroup property. 

• They can be applied to large-scale systems composed of multiple interacting 
subsystems. 

• They allow the explicit computation of the gain function for the composite 
system. 

• They allow for nonuniform in time stability phenomena. 

• They allow nonzero diagonal gains for each interacting system. This gener- 
ality is important for studying nonlinear uncertain and time-delay systems. 

• They allow vector Lyapunov function (or functional) characterizations for 
various stability properties. 

• They allow the application of the small-gain perspective to various systems 
which satisfy less demanding stability notions than ISS or lOS. 

5. Hypotheses (SGI), (SG2) hold automatically when Hypotheses (Hl-3) of The- 
orem 3.1 in [27] hold (Hypotheses (Hl-3) in [27] correspond to the special case 
S(t) — X and ^ — to). Consequently, Hypotheses (SGI), (SG2) are less restric- 
tive than previous ones. Indeed, inequalities (5.4), (5.5) are not assumed to hold 
for all times t e [to, ?max) but only after the solution map (p(t, to, xo, u, d) has 
entered the set S(t) C X. 

6. It should be mentioned that alternative sampled-data feedback designs for sys- 
tem (5.145) applied with zero-order hold and positive sampling rate can be 
obtained by using the results [41, 42], which, however, achieve semiglobal 
and practical stabilization. However, the feedback design obtained by using the 
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trajectory-based small-gain results of the present chapter guarantee global and 
asymptotic stabilization. Moreover, robustness to perturbations of the sampling 
schedule is guaranteed (that is the reason for introducing the input w in the 
closed-loop system (5.146)). 

7. The advantage of vector Lyapunov function versus single Lyapunov function 
in nonlinear stability analysis has been well documented in past literature [12, 
36, 40]. Recent work in [29, 32] provides further evidence on the usefulness of 
vector Lyapunov functions for the case of input-to-state stability. 

8. The results on monotone operators of Sect. 5.2 are closely related to results 
presented in [44, 45, 51]. 

9. It is worth noting that Theorem 4.1 and Corollary 4.3 in [29] can be eas- 
ily derived from Theorem 5.6 and Corollary 5.3 with yij(s) = a{s) for all 
i, j — I, . . . ,k and Q{x) = 0, where a e A/i with a(s) < s for s > 0. More- 
over, it is assumed in [29] that there exist a constant R > and a function 
p e ^00 such that \x\ < R + p(\H(x)\). In the presented framework, such a 
hypothesis is not needed. The interpretation of the family of set-valued maps 
m+ X m" 3 {T,x) -^ Ai(T,x) C sr (/ = 1,...,A:) defined in (5.119) is the 
following (the same with [29]): each Ai{T,x) C 9t" is the set of all states 
xo e J){" so that the solution of x(t) — f(x{t),xo,d(t),u(t),u(0)) with ini- 
tial condition x(0) — xq can be controlled to x e !1{" in time s less than or 
equal to T by means of appropriate inputs (d,u) e Md x My, that satisfy 
^(sup,g[o.s] l'<(^)l) < V/(x) and such that the trajectory of the solution sat- 
isfies the constraint maxy=i ..._<; sup,g[Oi] K/,/(^/'(-^('^))) — ^iM- In general, 
it is very difficult to obtain an accurate description of the set-valued maps 
m+ X !H" 3 (T,x) -^ Ai(T,x) C M« defined by (5.119). However, for every 



< 



g e C'(m"; di), we have Ai(T,x) c Bf(T,x) = {xq e di" : \gixQ) - g(x)\ 
Tbfix)} for all (T, x) e di+ x di'\ where 

bf(x) ■.^max\\Vg{^)f(^,xo,d,u,uo)\ : d e D, ^[max{\u\, |mo|}) < V,(x), 

max yij{max{Vj(^), Vj{xo)}) < V,(x) < +oo 

and Vi e C^{di"; Dt"*") (i — 1, . . . ,k) are the functions involved in the hypothe- 
ses of Theorem 5.6. 

10. Examples 5.4.1 and 5.4.2 have appeared previously in [27]. Examples 5.4.3, 
5.4.4, and 5.4.5 have appeared in [28]. The application of the small-gain results 
to dynamic strategic games was presented in [35]. 

11. It should be noted that the method of proving stability by means of fixed-point 
theorems developed by Burton (see [3]) is very closely related to the small- 
gain methods. Another connection between small-gain methods and fixed-point 
theorems is provided by Corollary 5.4. 

12. It is of interest to note that some of the functionals Qi : [— r -|- r;, -|-oo) x 
C'°([— A";, 0]; 9t") -^ Di"*" in Theorem 5.5 and Corollary 5.2 are allowed to be 
functions (case of r, — 0). This reminds the case of Razumikhin functions, 
which are used frequently for the proof of stability properties of systems de- 
scribed by RFDEs (see [13, 33, 39, 43, 50]). Consequently, Theorem 5.5 and 
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Corollary 5.2 allow the flexibility of using Lyapunov-like functionals with 
Razumikhin-like functions in order to prove desired stability properties. Teel 
[50] was the first to observe that Razumikhin results are essentially small-gain 
results. 
13. (Comparison of Theorem 5.3 and Corollary 5.1 with existing results): The 
reader should compare the result of Corollary 5.1 with Theorem 3.4 in [32]. 
It is clear that Theorem 3.4 in [32] is a special case of Corollary 5.1 with 
Yij (s) — a{s) for all i, j — I, . . . , k, where a e Afi with a{s) < s for s > 0. 
Alternative vector Lyapunov characterizations are based on the main results in 
[5, 7, 8, 32] or on the cyclic small-gain condition in [51] (see, for example, 
Theorem 2 in [20]). In order to demonstrate the applicability of our results to 
large-scale interconnected systems, consider the case 

Xi — fi(d, x,u) i — I, . . . ,k 

X = (x'p . . . , x[y edi^,deD,ueU 

where x, e 9t"' ,i — l,...,k,N — n[ + --- + nk,Dc1^i'isa nonempty compact 
set, [/ c Dfl™ is a nonempty set with e U , fi : D xm^ x U ^ 'M, i ^ I, . . . , k, 
are locally Lipschitz mappings with fi(d, 0, 0) = for all ^ e Z), / = 1, . . . , ^. 
We assume that the DISS property holds for each subsystem i, = fi(d,x, u) 
with input (m,xi, . . . ,x,_i, x,_,_i, . . . .x^:) (/ = 1, . . . , fe). Let V,- e C^(di"'; di'^) 
(i = I, ... ,k) he ISS-Lyapunov functions for each of the subsystems, i.e., posi- 
tive definite and radially unbounded functions for which the following inequal- 
ities hold for i — I, . . . ,k: 

supls/ Viixi)fi(d, x,u):ueU,x^{x[,..., x[)' e m^ , 

max{^(|M|),maxy/,j(y/x,))| < y/(x,)| < -p,(y/(x,)) 

for all Xj ^ 

for certain functions ^ eN'i,yij e Afi,i, j = I, . . . ,k, and certain positive def- 
inite functions p, e C°(Ot"'"; di'^) (i — I, . . . , k). Working with the Lyapunov- 
like functions V, e C^(S){"'; S1{+) {i ^l,...,k) and exploiting Corollary 5.1, 
we can guarantee that the UISS property holds for the above system if the 
small-gain conditions (5.3) hold. It should be clear that the functions ytj e N\ , 
i, i — I, . . . ,k, are the actual gain functions, i.e., the following inequalities hold 
for all i = 1, . . . , ;t, r > 0, x(0) e 9{^, and u e Mv. 

y,(x,(o) 

<max CT/(y/(x/(0)),f),q sup |M(r)|), max y,j( sup V/(j^j(t))) 
' ^0<r<r ^ ./¥' \<T<t ' ' ' 

for certain ct,- e KL (i — I, . . . ,k). Since Yi.ii^) — for / — I, . . . ,k, then 
the above inequalities are nothing else but the inequalities of the max- 
formulation of the UISS property for each subsystem x, — fi(d,x,u) with 
input (m, xi, . . . , x,_i, x,-|_i, . . . , Xk) {i —I, . . . ,k) and V,(x,) replacing |x; | for 
i^l,...,k. 
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Chapter 6 

Robust Output Feedback Stabilization 



6.1 Introduction 

This chapter is devoted to the analysis of the problem of the Robust Output Feedback 
Stabilization Problem. In order to be able to pose the problem rigorously, we need 
the notions described in previous chapters and particularly: 

• the notion of a control system (see Chap. 1), 

• the notion of the equilibrium point of a control system (see Chap. 1), 

• the notion of the feedback interconnection of control systems (see Chap. 1), 

• the internal and external stability notions for dynamical and control systems (see 
Chaps. 2 and 4). 

The emphasis is placed on systems described by ODEs and RFDEs. However, it 
will be clear that most of the obtained results can be generalized to wider classes of 
control systems with uncertainties. 

Another issue which is important in this chapter is the introduction of errors. 
Although feedback and control have been proved to be extremely useful for the sta- 
bilization of many practical systems, it is also a well-known fact that the application 
of feedback control does induce a variety of errors to the closed-loop system. Ex- 
amples of such errors may take the form of measurement noise, actuator noise, and 
parameter variations. Therefore the behavior of the system under feedback control 
can be analyzed using the external stability notions developed in Chap. 4. 

The existence of stabilizing feedback laws and the feedback design problem are 
not yet fully understood for nonlinear systems. During the last decades, significant 
progress has been made for the solution of these problems. The main idea of the 
present chapter is that for every method of proving stability, there is a method of 
stabilizing feedback design. The feedback design for linear control systems is pre- 
sented as a method based on analytical solutions. The feedback linearization method 
is presented as a method based on transformation results. The Control Lyapunov 
Function (CLE) methodology is presented as a method based on Lyapunov function- 
als. Finally, small-gain methods are also described for feedback systems. However, 
as noted in previous chapters, since methods of proving stability can be (and usually 
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are) combined, many methods of feedback design can be combined as well when 
one confronts real-world control system design problems. 



6.2 Description of the Robust Output Feedback Stabilization 
Problems 

In order to introduce the feedback stabilization problems, we start with an example 
which illustrates all main issues in feedback stabilization. 

Consider the chemostat with one microbial population and one nutrient described 
by the system of ODEs (1.4) or its equivalent form (1.7). Clearly, there are two 
inputs (mi, M2) G [— 1, +00) X [— M, +00) that correspond to the dilution rate D 
and the inlet concentration of nutrient Sm- As shown in Chap. 2 (Example 2.7.3), the 
origin e ?i\^ is URGAS for (1.7) under the following three assumptions: (i) both 
inputs are zero (i.e., the dilution rate D and the inlet concentration of the nutrient 
Sia assume constant values, equal to the nominal ones); (ii) the specific growth rate 
li{s) is an increasing, locally Lipschitz, bounded function, and (iii) the mortality 
rate is zero, and the yield coefficient is constant. 

However, in many cases, one of the above assumptions does not hold. For exam- 
ple, there are situations where (see [38] and references therein) the specific growth 
rate is not an increasing function: there is substrate inhibition in the growth of the 
microbe. In such cases, system (1.4) may have two (or more) equilibrium points 
except the trivial equilibrium point {s, x) — {s-m, 0). This implies that e iH^ is not 
URGAS for (1.7). In fact, the region of attraction of e S)i^ for (1.7) can be a very 
"small" subset in iii- (see [38] and references therein). Furthermore, the assumption 
that the inlet concentration of the nutrient s\„ assumes a constant value, equal to the 
nominal one, is usually an unrealistic assumption. 

All the above considerations lead us to the conclusion that the operation of the 
chemostat without control may drive the states to an operating point different from 
the nominal point. How can we force the states of the system (1.7) to approach the 
desired position e ilt^ ? 

Since the inlet concentration of the nutrient s\n is usually determined by other 
processes, we can think of the following idea: use the input mi e [—1, -l-oo) (or 
the dilution rate D) in order to force the states of the system (1.7) to approach the 
desired position e i)i^. Mathematically, there are two ways of achieving such a 
goal: 

• Given the initial state xq — {x\fl,X2fi) e 9i^ and assuming knowledge of the 
input M2 e [— M, +00) on a time interval [0, T}, calculate an admissible input 
u\ : [0, T] —>■ [—1, -|-oo) that will bring the states the system (1.7) "close" to the 
desired position e J)i^ in "an optimal way." 

• Given a continuous measurement of the state vector x(t) — (xi (t), X2(0) e di^, 
find a "law" which will adjust "automatically" the value of the input ui(t) e 
[—1, -l-oo) depending on the current position of the state. The automatic "ad- 
justment law" must guarantee that the states of system (1.7) will be "close" to 
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the desired position e di^ after an initial transient period. In other words, we 
are looking for a function k : di^ ^ [— 1, +oo) such that the "adjustment law" 
ui{t) — k(xi (t), X2(f )) for all r > will achieve the objective. 

The first approach is the approach followed in the literature of Optimal Control. 
The second approach is the robust feedback stabilization approach. The advantages 
and disadvantages of each approach are discussed in many books (see the discussion 
in [64]). In this chapter, we discuss the second approach. 

The reader should notice that the function k :di^ ^ [—1, +oo) that we have to 
find in the feedback stabilization approach is called "the controller" or the "static 
state-feedback stabilizer." However, what we have described so far does not consti- 
tute a well-posed problem. The following questions can be asked: 

Question 1 What do we mean by "close" to the desired position e S)t^? 

The answer to the question is crucial and is strongly connected to the following 
question: 

Question 2 What about the input U2 e [— M, +oo)? 

There are two possible answers to the above questions: 

(a) In the case where the input ui is identically zero (i.e., the inlet concentration 
of the nutrient s^ assumes a constant value, equal to the nominal one), we can 
seek a static state-feedback stabilizer k:'i)\^ ^ [—1, +oo) which will guarantee 
that e 9J^ is URGAS for the dynamical system 

XI = D*[g{x2) -k(x\,X2)) 

X2 = £>*exp(-X2)[M(l - /7(x2)exp(xi)) - RMp{x2)g(x2)e.x^(,xi) (6.1) 

+ 1 -exp(x2) + ^(xi,X2)(M+ 1 -exp(x2))] 

Notice that the dynamical system (6.1) is obtained by the substitution of 
k{xi,X2) in place of u\: this is justified since the value of the input u\(t) e 
[— l,-|-oo) follows the "adjustment law" Mi(f) — k(xi{t),X2(t)) for all r > 0. 
System (6.1) is termed as "the closed-loop system" (1.7) with feedback law 
M) — k(xi,X2)- Of course, system (6.1) is a system described by ODEs, and 
consequently the function k : i)J- ^- [— 1, +cxd) must satisfy certain regularity 
properties in such a way that system (6.1) is well defined. 

(b) In the case where the input U2 may assume nonzero values and is unknown, we 
have to take into account the effect of the external input U2- In this case it is 
natural to search for a static state-feedback stabilizer which will guarantee that 
the control system 

XI = D*{g{x2)-k(xi,X2)) 

X2 — Z)*exp(-X2)[M(l - p(x2)exp(xi)) 

-, (6.2) 

- RMp(x2)g(x2) exp(xi) + 1 - exp(x2)J 

+ D*exp(-X2)[M2 + fc(xi,X2)(M+ 1 + U2 -exp(x2))] 
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satisfies the (W)ISS property from the input uj- Notice that it may not be 
possible to guarantee the (W)ISS property for all measurable and locally es- 
sentially bounded inputs M2 '■ ^^^ -^ [—M, +00). However, it may be possi- 
ble to guarantee the (W)ISS property for all measurable and locally essen- 
tially bounded inputs U2 '■ di'^ -^ [—L,L], where L < M. Again, the func- 
tion k : J)i^ ^ [— 1, +cxd) must satisfy certain regularity properties so that sys- 
tem (6.2) is well defined. In this case the feedback stabilization problem is 
termed as "robust" since the (W)ISS property from the input U2 will guaran- 
tee robustness properties for the solution of system (6.2) for all initial states 
Xfj — (xi 0, ^2,0) € ^{^ and for all measurable and locally essentially bounded 
inputs U2 : di~^ -^ [—L, L]. Finally, again system (6.2) is termed as "the closed- 
loop system" (1.7) with the feedback law ui — k(xi,X2)- 

An additional comment is needed at this point. We have described the con- 
trol objective above as the satisfaction of the (W)ISS property from the in- 
put U2- However, the weight function 8 e K~^ involved in the WISS property 
is important: if the weight function S e K~^ is bounded from above, then the 
closed-loop system will satisfy the Bounded-Input-Bounded-State property and 
the Converging-Input-Converging-State property. In general it will be better to 
be able to guarantee that the weight function S e K~^ is as small as possible: 
for example, if the weight function S e K^ is given by &{t) — exp(— r), then 
clearly the state will converge to zero even if the absolute value of the input U2 
increases exponentially. Unfortunately, as one can imagine, this is not always 
achievable. 

We next continue with some other significant questions. 

Question 3 Do we have accurate measurements of the full state vector x(t) — 
(xi (t), X2(t)) e !M^ at every time instant? 

In many problems, it is impossible to measure accurately and continuously the 
state variables. Instead, we can measure only some components of the state vec- 
tor or more generally a function of the state vector denoted by y — h(x), where 
h :di" ^- 9{*. In this case, the vector y — h(x) is called the "measured output," or 
simply the output. 

More specifically, for the chemostat problem, we can measure the concentration 
of the nutrient s and thus obtain X2- However, in many problems it is impossible (or 
very expensive) to measure continuously the concentration of the microbial species. 
Therefore, in such cases the "adjustment law" ui(t) — k(xi(t), X2it)) for all f > 
cannot be implemented. 

There are two possible ways to address the above challenge. 

(a) Try to find a static output-feedback law which is independent of xi, i.e., try to 
find a function ^ : !W ^ [—1, +00) which will guarantee that the closed-loop 
system (1.7) with mi — k(x2) satisfies the (W)ISS property from the input U2- 

(b) Instead of looking for a static output-feedback stabilizer, one can think of a 
dynamic output feedback stabilizer. In this case, we are looking for functions 
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/ : !){2 ^ *){ and k : 9i^ ^ [-1, +oo) so that the "adjustment law" uiit) — 
k(w(t), X2(0) for all f > 0, where w{t) is the solution of the system 

w{t)^f{wit),x2(t)) wit) em (6.3) 

can guarantee the (W)IOS property for the closed-loop system (1.7), (6.3) with 
u\ — k(w,X2) from the input U2 to the redefined output Y — {x\ , X2) € di^ . In 
this case the controller is a control system with input X2 and output mi which 
has internal dynamics. The available information (the measurement of X2) is 
fed to the controller which calculates the control action. Moreover, in this case 
the state vector of the closed-loop system (1.7), (6.3) with ui — k(w,X2) is 
(.x:i,.x:2, w) e di^, and the control objective is the (W)IOS property from the 
input M2 for the new output Y — (xi, X2) e di^. 

Question 4 Can we adjust "continuously" the value of the input m 1 (f ) e [— 1 , +00)? 

In many cases the control mechanism cannot adjust the value of the input con- 
tinuously: instead, we can only adjust the value of the input every T time units. For 
the chemostat, the value of the input u\ is adjusted in practice by opening a valve. 
It is possible to adjust the position of the valve by an automatic (analog) mecha- 
nism. However, this strategy is impractical when the feedback law is intricate (e.g., 
dynamic). When this happens, the control action is computed by means of a digital 
mechanism which determines the control action every T time units. Taking the non- 
linear state-feedback k{xi,X2) as an example, the closed-loop system will become 

xiit) ^ D*{g{x2(t)) - k{xi(ri), X2(ri))) 

i2(t)^D*exp{-X2(t))[M{l-p{x2(t))exp{xi(t))) 

- RMp{x2{t))g{x2(t)) exp(xi(0) + 1 - exp(x2(f))] 

+ D* exp{-X2(t))[u2(t) + k{xi(ri), X2(ri)){M + 1 + U2(t) 

-exp(x2(0))] 

T,+i ^n + T (6.4) 

Notice that system (6.4) is a system with fixed sampling partition. The control input 
ui{t) is kept constant during two consecutive members of the sampling partition, 
i.e., is constant on [r,-, r,_|_i). This is usually called "the application of the feedback 
law ui — k{xi,X2) with zero-order hold." 

Another issue that can lead to a closed-loop system with variable sampling parti- 
tion is that the measurement of the state vector may not be available "continuously" 
but rather every T time units. For the chemostat, we can only measure the concen- 
tration of the nutrient s. It is possible that the measurement of the nutrient can be 
given in an irregular manner: two consecutive measurements can be given in times 
Xj and r,-(_i which satisfy r,-|_i < r, + T for a positive constant T > 0. In this case, 
we are looking for functions / : SH^ -^ SH and k : 9{^ ^- [— 1, +00) such that the 
(W)IOS property from the input (m2, M3) holds for the control system 
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xi(t) ^ D*{g{x2it)) - k{wiri),X2(ri))) 

X2(t) = D* &xp(-X2(t)) [M(l - p(x2it)) exp(xi (?))) 

- RMp{x2it))g{x2(t)) exp(^i(0) + 1 - exp(x2(0)] 

+ D* exp{-X2(t))[u2(t) + k{w(ri), X2(ri)){M + I + U2it) 

-exp(x2(r)))] 

w(t)^f{w(t),X2(ri)) 

r,+i = T, + rexp(-M3(r/)) (6.5) 

where the input M3 e d\~^ is introduced in order to represent the uncertainty of the 
sampling instances. 

There are many other questions which can be significant for this problem. For ex- 
ample, the following questions are also important, and their answers may be crucial 
for a given control problem: 

Question 5 Are there any delays and measurement error in the measurement pro- 
cess? 

Question 6 Can we use the past values of the measured output? 

From the above it is clear that the feedback stabilization problem is theoreti- 
cally important and challenging, and practically relevant. Now, we are ready to state 
mathematically the Robust Output Feedback Stabilization Problem. 

The Robust Output Feedback Stabilization Problems 

Consider 

(i) a deterministic control system IJ[ — {Xi , F 1 , M^^ ^ jj , Mo ,^i,Ki,h) with out- 
puts and the BIC property, for which h ■.m+ x Xi x U ^ Si '^yi, S2 '^y2, 
3^2 being a normed linear space, and e A"! is a robust equilibrium point from 
the input {v2, u) e Ms2xU, 

(ii) a normed linear space y and a continuous map H : SH"*" x X\ x S2 x U —y y 
that maps bounded sets of 5)^+ x Xi x S2 x U into bounded sets of y, with 
H(t, 0, 0, 0) = for all t > 0, called the "stabilized output map". 

For reasons that will become clear below, the output map H : d\~^ x Xi x S2 x 
U ^^ y will be called the "stabilized output," while the output h : ^\~^ x Xi x S2 x 
U ^^ Si c.yi will be called the "measured output." 

The Robust Output Feedback Stabilization problems consist of: 

(1) (The existence problem) Is there a deterministic control system of the form 
^2 = (X2,Y2,Msiy,u,MD,4>2,7t2,H2), where H2 : d\+ x X2 x Si x U ^ 
S2 ^ 3^2 > with outputs and the BIC property for which e <Y2 is an equilib- 
rium point such that the feedback connection S :— (X , y, Mjj , Md, (f>, n, H) 
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of systems Zi and S2 with output H : 5)^+ x X[ x X2 >^ U ^^ y defined by 
H(t,xi,X2, u) :— H(t,xi, H2{t,X2, h(t,xi, u), u), u) is well defined and satis- 
fies the lOS property from the input u e Mu ? 
(2) (The feedback design problem) Design a deterministic control system E2 — 
(X2,Y2, Ms.xu, Md,4>2, TT2, H2), where H2:m+ x X2 x Si x U ^ S2 ^ 3^2, 
with outputs and the BIC property for which e A^ is an equilibrium point such 
that the feedback connection E :— (X, y, Mu, Mo, (p,7t, H) of systems Si 
and Z2 with output H : ?l\'^ x Xi x X2 x U ^ y defined by H(t, xi , X2, u) :— 
H{t, xi, H2(t, X2, h(t, xi, u), u), u) is well defined and satisfies the lOS prop- 
erty from the input u e Mu . 

Particularly, the deterministic system Z2 — (X2,Y2, Mg^^u, M[),<j)2,7t2, H2) is 
called the "feedback stabilizer" or "the controller." If the deterministic system 
E2 — (X2 , Y2 , Ms^ X u > Md ,4>2,^2,H2)is required to be a static map, then we refer 
to the corresponding feedback control stabilization problem as "static." If the deter- 
ministic system S2 — (X2,Y2, MsjxU, Mu, (p2,^2, H2) is «of required to be a static 
map, then we refer to the corresponding feedback control stabilization problem as 
"dynamic." 

It should be clear that the controller exploits the output h : S)i"'" x Xi x S2 x U ^y 
Si c yi as an input in order to produce the output H2 '■ ^i^ x A:2 x ^i x U ^ 82^ 
3^2 ■ In practice, the controller can only take information of certain measurements of 
the variables involved in the system Zi — (Xi,Yi, Mj^xt/, Mo, (j)i,7t\, h). This is 
the reason that the output h : d\^ x Xi x S2 x U ^ Si c. yi h called the "measured 
output." 

In general, the measured output and the regulated output do not coincide. How- 
ever, special attention will be given to the problem where the measured output and 
the regulated output coincide to the state of Ui — (Xi ,Yi, Mg^ x u > Mo ,4>i,^i,h). 
In this case, the output feedback stabilization problem reduces down to the state 
feedback stabilization problem. 
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Every mathematical model of a physical system has a certain degree of accuracy. 
Therefore, modeling errors are always present to every description of a process. The 
effect of modeling errors can be detrimental for systems stability and performance 
and must always be taken into account in control systems design. For example, 
the chemostat stabilization problem described in the previous section is based on 
the mathematical model (1.7). The input M2 represents the deviation of the inlet 
concentration of the nutrient from its nominal value. In other words, the input M2 
quantifies the effect of modeling errors with respect to the inlet concentration of the 
nutrient. 

When feedback control is applied to a system, two additional sources of errors 
for the closed-loop system may arise, as stated previously: 
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(1) Actuator errors 

The actuator errors represent the deviation between the applied control action and 
the nominal control action which is determined by the feedback law. Actuator er- 
rors are often present to control mechanisms and must not be neglected. For exam- 
ple, in order to quantify the effect of actuator errors for the closed-loop chemostat 
model (6.2), we can introduce an additional input M4 : di~^ —^ !W so that the actual 
control action u 1 (?) is determined by the equation 

Mi(f) = max{-l,A:(x(0) + M4(0} (6.6) 

Notice the nonlinear character of (6.6): it reflects the fact that the input ui(t) must 
always take values in the set [—1, -|-oo) or, equivalently, that the dilution rate D 
must be nonnegative. Therefore, the closed-loop system (1.7) with the feedback law 
(6.6) is described by the following nonlinear system: 

xi — D*(^g{x2) — max{ — 1, k(x) + M4}) 

X2 — D*exp(-X2)[M(l - /7(x2)exp(xi)) 

' (6.7) 

- RMp(x2)g(x2) exp(xi) + 1 - exp(x2)J 

-|- D*exp(— X2)[m2 + max{ — 1, k{x) + M4}(M -|- 1 -|- M2 — exp(x2))] 

(2) Measurement errors 

The measurement error, or sensor noise, represents the deviation between the ac- 
tual value of a measured output and the value which is provided by a measurement 
device. Unfortunately, measurement errors are always present to every measuring 
mechanism and can significantly affect the behavior of the closed-loop system. For 
example, in order to quantify the effect of measurement errors for the closed-loop 
chemostat model closed-loop system, i.e., (1.7), (6.3) with ui = k{w,X2), we can 
introduce an additional input M5 : 9{"'" -^ Ot so that the measured value of the out- 
put X2{t) is corrupted by the additive error u^it). Therefore, the closed-loop sys- 
tem (1.7), (6.3) with Ml — k(w, X2) is described by the following nonlinear system: 

xi — D*[g(x2) — max{ — 1, k(w, X2 + M5) -I- M4}) 

X2 = Z)*exp(-X2)[M(l - /:)(x2)exp(xi)) 

- RMp(x2)g(x2)e\p(xi) + 1 - exp(x2)] 

-I- D* exp(— X2)[m2 + max{ — 1, k(w, X2 + M5) + M4} 

X [M + I + U2 — exp(x2))] 

w — f(w,X2 + U5) (6.8) 

Again, the input M4 : Sit"'" —>■ di is introduced in order to quantify the effect of the 
actuator error. The control objective in this case is to find functions / : di^ -^ di and 
k-.'iR^^ [—1, -l-oo) and constants L\ e (0, M], Li > (i — 2, . . . , 6) so that sys- 
tem (6.8) satisfies the (W)IOS property from the inputs (u2, U4, M5) e [—Li, L2] x 
[— L3, L4] X [— L5, L(i] for the regulated output F = (xi , X2). 
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6.4 Analytical Solutions 

In Chap. 2, we have already encountered the method of proving stabihty by means 
of analytical expressions of the solutions of a system. This method is particularly 
useful for linear systems. The usefulness of the method still holds for the feedback 
stabilization problem. 

A linear autonomous control system described by ODEs takes the form 

X — Ax + Bu 

xeW,ue^r (6.9) 

where A e jy{"^" and B e gft"^'" are constant matrices. For linear systems of the 
form (6.9), it can be shown that there exists a continuous stabilizing feedback that 
guarantees that e SH" is UGAS if and only if there exists a linear stabilizing feed- 
back, i.e., there exists a matrix K e di'"^"' such that (A + BK) is Hurwitz (see [64]). 
In the latter case, the pair (A, B) is said to be stabilizable. Conditions for the pair 
of matrices A e i1{"^" and B e 3t"^™ to be stabilizable are given in the literature 
(see [64]). 

The same comments are applicable to the linear autonomous discrete-time case 

x(t+ l)^Ax(t) + Bu(t) 

x(t)em",uit)em"\teZ+ (6.10) 

where the objective is the existence of a matrix K e J){'"^" such that (A + BK) has 
all its eigenvalues strictly inside the unit circle (see [64]). 

A less obvious application of the method of analytical solutions is the control 
design for homogeneous systems described by ODEs. A control system described 
by ODEs of the form 

i(r) = /(x(0,M(f)) 

xit)em",u{t)em (6.11) 

where / : S)f' x S)t ^^ S)i" is locally Lipschitz with /(O, 0) — 0, is characterized as 
homogeneous if there exist numbers r,- > (; = 1, . . . , n), p > 0, and q ed\ such 
that the equality 

f{x,u)^S;'-{a-''f{S'^(x),aPu)) (6.12) 

holds for all (x,u) e di" x di and a > 0, where 

S'„(x)^ (a'''xi,...,a'"x„)' edi" 

" ^ ' (6.13) 

S-'ix) = {a-" XI,. . . , a-''"x„)' e S)i" 

Although the solution 0(f,xo; u) of system (6.11) at time t > with initial condition 
x(0) — xq e S1{" and corresponding to a measurable and locally essentially bounded 
input u : di~^ —>■ di cannot in general be computed by means of elementary functions, 
it can be shown that the following equality holds: 

S'^{(P{a''t,S-''{xoy, a-Pu)) ^ (t)(t,xo; u) (6.14) 
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for all a > and xq e di" , for all measurable and locally essentially bounded input 
u : Ot"*" —>■ SW, and for all f > for which (/)(r, xq; m) and (pia'^t, S~''{xo); a~Pu) ex- 
ist, where a~Pu : Sit"*" -^ di denotes the measurable and locally essentially bounded 
input that satisfies (a~Pu)(t) — a~Pu{t) for almost all f > 0. 

Define N{x) := \x\\^l''^ H h kJ^/'''' for x = (xi, . . . , x„) e Dt". Suppose that 

we know the solution 0(f,xo; m) of system (6.11) at every time f > with ini- 
tial condition x(0) — xq e W satisfying N{xo) — 1 and corresponding to every 
measurable and locally essentially bounded input u : D't"'" — > di. Then, using formu- 
lae (6.14), we can compute the solution 4>{t, xq; u) of system (6.11) at every time 
f > with initial condition x(0) = xq e flt" and corresponding to every measurable 
and locally essentially bounded input u : SW"*" -> 9i. Indeed, formula (6.14) gives 

(Pit, xo; m) = 3;v(,.^) {(l>{NHxo)t, SN[,Jxoy, ^-''(xo)m)) for all xq / 

Since y = S^l,^^{xo) satisfies N(y) = 1, (t)(NHxQ)t,S-l^^^{xo); N-P(xq)u) is 
known by assumption. 

Formula (6.14) is an essential feature of homogeneous systems which can be 
utilized for the solution of the feedback stabilization problem (see [5, 10, 16, 17] 
and references therein). 
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One method for the design of stabilizing feedback for nonlinear autonomous sys- 
tems described by ODEs is the method of feedback linearization (see [20, 52]). 
Since the method is analyzed rigorously in many other books, we will only discuss 
briefly the scope of the method and its relation to the transformation methods of 
proving stability. 

The problem studied by feedback linearization methods can be described as fol- 
lows. Consider the nonlinear control system 

X = fix) + g{x)u 

xedWuem"" (6.15) 

where / : JR" ^- Dt" and g : Dt" — >• f}i"^"' are locally Lipschitz mappings with 
/(O) — 0. If we are in a position to find a diffeomorphism : ;H" -^ di" and a 
locally Lipschitz mapping /r : 9t" ^- Dt™ such that 

D0{x)(f{x) + g(x)kix)) ^ A0(x) 

(6.16) 
D<Pix)g(x) = 5 

for all X e dt", where A e fji"^" and B e J)J"^"' are constant matrices, then the 
closed-loop system (6.15) with u — k(x) + v under the change of coordinates : 
9t" —>■ di" will be the linear control system 

z — Az + Bv 

zedi",vem'" (6.17) 
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The design of a stabilizing feedback for the hnear system (6.17) can be performed by 
using linear control theory as long as the transformed system (6.17) is stabilizable. 
Therefore, if the feedback law 

v^Kz (6.18) 

guarantees that e SH" is GAS for the closed-loop system (6.17) with (6.18), then 
Proposition 2.1 in Chap. 2 implies that e W is GAS for the closed-loop sys- 
tem (6.15) with 

u^k(x) + K<p-\x) (6.19) 

The theory of feedback linearization has dealt with necessary and sufficient con- 
ditions for the existence of a diffeomorphism : 9{" -> W , a locally Lipschitz 
mapping k : di" —>■ S){'", and a stabilizable pair of constant matrices A e ;)t"^" and 
B e m"""" such that (6.16) holds. 

In many cases we can guarantee the existence of a local diffeomorphism : 
Dt" -^ di", a locally Lipschitz mapping k : ilt" -^ S)i™, and constant matrices A e 
^nxn ^jjjj g g gj«xm ^^^j^ jj^^j (g jg) j^^j^j^ locally. The theory of global feed- 
back linearization is far from being complete. The interested reader should consult 
the rich and mathematically sophisticated feedback linearization literature for many 
deep and interesting results. 



6.6 Lyapunov Functionals: The Control Lyapunov Functional 

The feedback design methodology by means of a Control Lyapunov Functional 
is the method that corresponds to the method of proving stability by means of 
Lyapunov functionals. It should be noticed that the Control Lyapunov Functional 
methodology has been developed mostly for control systems described by ODEs 
and control systems described by RFDEs. 

Exactly as the method of proving stability by means of Lyapunov functionals 
admits two different approaches (the discretization approach and the Lyapunov ap- 
proach, see Chap. 2), the feedback design methodology by means of a Control Lya- 
punov functional admits two different approaches: 

1 . The Coron-Rosier approach 

2. The Artstein-Sontag approach. 

Next, we study each approach separately for systems described by ODEs. 



6.6.1 Control Systems Described by ODEs: The Coron-Rosier 
Approach 

This methodology is based on the following idea: given a Control Lyapunov Func- 
tion (CLF), design a feedback law so that the difference of the values of the CLE 
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evaluated along the solutions of the closed-loop system at time instances which dif- 
fer by a constant quantity becomes negative. Notice that this methodology does not 
guarantee that the time derivative of the CLF along the solutions of the closed-loop 
system is negative definite. 

Using this methodology in their pioneering work [12], Coron and Rosier showed 
that the existence of a time-independent CLF satisfying the "small-control" property 
is a sufficient condition for the existence of a continuous time-periodic stabilizing 
feedback for general nonaffine disturbance-free autonomous nonlinear control sys- 
tems with U — 9{'" and output Y being identically the state of the system (see also 
[10]). The result has been generalized in [37], where it was shown that the existence 
of a CLF is a necessary and sufficient condition for the existence of a continuous 
time-varying stabilizing feedback for systems of the form (1.3) with U C ilf" being 
a positive cone (not necessarily convex). 

Here, we will only present results which allow the construction of locally Lip- 
schitz feedback laws. We consider systems of the form (1.3) under the following 
hypotheses: 

(HH) The mappings / : !U+ x £) x J)r x t/ ^ M" and // : Di+ x Di" -^ M*^ are 
continuous, and for every bounded interval / C i)J''~ and every compact set 
S C S}{" X U , there exists a constant L > such that 

\f{t,d,x,u) — f{t,d,y,v)\<L\x — y\+L\u — v\ 
V(f , d)el X D, (x, u) e S, (y, v) e S 

Moreover, the set D C iW' is compact, and C/ is a closed positive cone, i.e., 
U c Df" is a closed set, and if ueU, then (ku) e U for all X e [0, 1]. 

Definition 6.1 We say that a function V e C^i'di'^ x S1{"; 9{+) is an Output Robust 
Control Lyapunov Function (ORCLF) for (1.3) under hypotheses (Hl-4) and (HH) 
if there exist functions ai , 02 e Kqc, ti, P e K'^ , p e C°(!W+; 9{+) that are locally 
Lipschitz and positive definite, and b e C°(!;)i+ x (9r\{0}); 9{+) such that 

1. for every (r, x) e S)t+ x !W", 

ai{\H(t,x)\ + fi(t)\x\)< Vit,x)<a2{P(t)\x\), (6.20) 

2. for every (f , x) e di+ x (SH"\{0}), 

/dV dV \ r X 

min max — (t,x)-\ (t,x) f(t,d,x,u) ] < -p(V(t,x)). (6.21) 

ueU,\u\<h(t,x) deD\ dt dx J 

For the case H(t, x) :— x, the corresponding V e C^(di'^ x SW"; SW"*") is called State 
Robust Control Lyapunov Function (SRCLF). 

We are now in a position to state the main result that guarantees the existence of 
a stabilizing feedback law. 

Theorem 6.1 Consider system (1.3) under hypotheses (Hl^) and (HH) and as- 
sume that (1.3) admits an ORCLF which satisfies (6.20), (6.21). Then there exists 
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a continuous mapping K : Dt"*" x M" — >• U with K(t,0) — for all t > 0, which 
is continuously dijferentiable with respect to x e. ?lV' on Di"*" x dV\ such that the 
closed-loop system (1.3) with u — K{t, x) is RGAOS. 

If in addition we assume that there exist a function a e Koo and a function q e 
C°(*)i+ X at"; m+) satisfying 



< q(t,x) < min 



1,^] V(f,x)e9{+x(!){"\{0}) (6.22) 



such that Jor all (t, x) e i)i+ x OH"\{0}), 

max{/7(T, y) : (t, 3;) e *){+ x S){", |t - f | + |y - x| < qir, y)} < a{Vit, x)) (6.23) 

where V e C\di+ x di";m+) is the ORCLF for (1.3), and b e C°(di+ x 
(S){"\{0}); at"*") is the function involved in (6.21), then the closed-loop system (1.3) 
with u — K{t, x) and output Y — K(t, x) is RGAOS. Particularly, this implies that 
for all {to,xo,d) e di'^ x di" x Mo, the control action [fo,+oo) 3 t ^ u{t) — 
K{t, x{t)) e U is bounded and converges to zero as t ^ +00, where x(-) denotes 
the solution of (1.3) with u — K(t,x), initial condition x(fo) — xq e di", corre- 
sponding to d e Mo . 

The proof of Theorem 6.1 is based on three lemmas below. Particularly, 
Lemma 6.1 is a preparatory result for the construction of the desired feedback sta- 
bilizer It constitutes a time-varying extension of Lemma 2.7 in [12], but its con- 
structive proof differs from the corresponding proof of the previously mentioned 
result. 

Lemma 6.1 Consider system (1.3) under hypotheses (Hl-4) and (HH) and assume 
that (1.3) admits an ORCLF which satisfies (6.20), (6.21). Then, for every function 
q e C°{m+ X m"; m+) satisfying (6.22), there exists a C^ function k : [0, 1] x 9t+ x 
im"\{0}) ^ U with 

(6.24) 

(6.25) 

(6.26) 



k(0,t,x)^k(l,t,x)^0 




dk dk 

— (0,f,x)=— (0,f,x) = 0; 

ds dt 


— (0,r,x) = 
dx 


^U,x)=^(U,x) = 0; 
ds dt 


-(l,r,x) = 
dx 


for allt>0,xe S)r\{0} and such that 





dV dV f^ , . 1 / X 

— (f,x)H (t,x) / f(t,d(s),x,k(s,t,x))ds <--p(V(t,x)) (6.27) 

dt 9x Jo ' 2 ^ ' 

for all {t,x) e Di"*" x (9i"\{0}), d e Mo- Moreover, the following inequality holds 
forall{t,x)em+ X (Dft"\{0}): 

max |A:(i,f,x)| < ^(f,x) (6.28) 

ie[0,l]' ' 

where, for all (t,x) e m+ x (SW"\{0}), 
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b(t,x):^max{b(r,y):ir,y)em+ x K" ,\r - t\ + \y - x\ <^(r,3;)} (6.29) 
with b(-, ■) the function involved in (6.21). 

Proof Let q e C°(9i+ x 9i"; ;ii+) satisfying (6.22), let ^ : 9{+ x (i)r\{0}) -^ ;)i+ as 
defined by (6.29), which is locally bounded on 9fl+ x (»l"\{0}), and let cp : i)i+ x 
(9r\{0}) -^ [1, +oo) be any smooth (C~) function such that, for all (t, x) e di+ x 
(9r\{0}), 

/dv dv \ 

max maxi — it,x)-\ (t,x)f{t,d,x,u)\<(p(t,x) (6.30) 

ueU.\u\<h{t,x)deD\dt dx ) 

Moreover, let e : 9{"'" x (S){"\{0}) -^ (0, 1) be a smooth function such that 

0<e(r,x)< Py^y^^^)) V(f,x)eS)t+ X (S)r\{0}) (6.31) 

'-4(p(y(?,x)) + ^(f,x)) \ w ^) y 

and define 

^(t,x,u) :=max — {t,x)^ (t,x)f(t,d,x,u)+ -p(V(t,x)) 

deD \ dt dx 4 / 

for all (r, X, m) e *){+ X SH" x U (6.32) 

t//(f,x,M):=i//(0,x,M) forall(r,jc,M)e(-l,0) xDi" X C/ (6.33) 

By virtue of (6.21), the continuity of 'P, and compactness of Z) C St', it follows 
that for each (t, x) e (-1, +oo) x (iH"\{0}), there exist u — u{t, x) e U with \u\ < 
b{t,x) and (5 — 8(t,x) e (0, 1] with Sit, x) <q{t,x) such that 

9{r,y,u{t,x)) < 
W{T,y)e{{r,y)e(-l,+oo) x Di" : |r - r| + |y - jc| <&} (6.34) 

Using (6.34) and standard partition of unity arguments, we can determine sequences 
{(ti,xi) e (-l,+oo) X (S)r\{0})}~i, {ui e U}°Zi, and {Si e (0, l]}°Zi with |«,| < 
b(max(0, ti), xi) and Si — S(ti, xf) < q(ti,Xi) associated with a sequence of open 
sets{^,}~j with 

^i c {(r, y) e (-1, +00) X m" : |r - r,| + |y - x/| < Si} (6.35) 

forming a locally finite open covering of (—1, +oo) x (i1t"\{0}) and that 

'^(r,y,M/)<0 W(r,y)ef2i (6.36) 

Also, a family of smooth functions {0,}^j with 6i(t,x) > for all (f,x) e 
(—1, +oo) X (9i"\{0}) can be determined with 

supp0,C^,- (6.37) 

00 

^0,(f,x)=l V(f,x)e(-l,+oo)x (i1{"\{0}) (6.38) 

! = 1 
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Next, define recursively the following mappings for each (t, x) e f)}"*" x (S)t"\{0}): 

Ti{t,x)^Ti-i(t,x)+0iit,x) i>l 

To(t,x)^0 

it,x)em+ x{m"\{0}) (6.39) 

Notice that definition (6.39) implies T„{x) — ^"=i ^/(f,.'^) for all « > 1. Since 
the open sets {^,}^j form a locally finite open covering of di~^ x (9t"\{0}), it 
follows from (6.37) and (6.39) that for every (t,x) e SU+ x (S1{"\{0}) there exists 
m — m(t, x) e {1, 2, 3, . . .} such that 

Ti(t,x) = l for i>m (6.40) 

Define the index set 

J(t,x):^{j eN:0j(t,x)>O} (6.41) 

which by virtue of (6.40 ) is a nonempty finite set. It follows from definitions (6.39) 
and (6.41) that 

IJ [Tj-i(t,x),Tjit,x))^[0,l) W(t,x)e[0,l]xm+ x{m"\[0}) (6.42) 

Let /z : JH — )• [0, 1] be any smooth nondecreasing function with 

h(s) = for .y < and h{s) =1 for i > 1 (6.43) 

and let 

gjit,x) := -0j(t,x) + -{s(t,x)2-J-^-0j(t,x)) 

/0i(t,x)-s(t,x)2-'-^\ 

where e(-, ■) is the function defined by (6.31). According to (6.43) and (6.44), it 
holds 

sit,x)2-'-^,-0j(t,x)\ <gj{t,x)<mm{E(t,x)2-'-^,0j(t,x)} (6.45) 

gj(t,x)^Eit,x)2~'~^ for0jit,x)>eit,x)2~'~^ (6.46) 

We define the following map [0, 1] x di+ x (9r\{0}) 3 (s, t, x) -^ k(s, t, x) e 9^: 

f gj(t,x) \\(s-Tj_,{,t,x)-\gj{t,x) 
k{s,t,x) — Uj\ _ ._, I n' 



mm 



,e(r,x)2-/-V V \gj{t,x) 

fors e 



Tj-i{t,x),Tj-i{t,x) + h0j(t,x)\jeJ{t,x) (6.47) 

,, , ^ ( Sj(t,x) \\( Tj{t,x)-yj{t,x)-s 

k{s,t,x) — u i\ ^^ h\ -. 

•'Ve(r,x)2-/-2; V \gj(.t,x) 

foxse Tj(t,x)--0jit,x),Tj{t,x)\,jeJ{t,x) (6.48) 

k(l,t,x)^Q (6.49) 
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Notice that, because of (6.42), k(-,-, ■) is well defined for all {s, t, x) e [0, 1] x 
D{+ X (S)r\{0}). Furthermore, according to definitions (6.47), (6.48), and (6.49), hy- 
pothesis (H2) guarantees that k(-, ■, ■) takes values in [/ c J){'" and is continuously 
differentiable on the region ([JjeJ(t,x) (Tj-i(t, x), Tj (t, x))) x S)i+ x (9i"\{0}). Fur- 
thermore, it holds that 

dk dk dk 

— (s,t,x)^0 — (s,t,x)^Q — (s,t,x)^0 

ds dt dx 

a.s,s^ Tj{t, x) for all y = 0, 1, 2, . . . (6.50) 

Next, we show that k(-,-,-) is continuously differentiable on the whole region 
[0, 1] X m+ X (S)i"\{0}) and simultaneously that (6.24), (6.25), and (6.26) are ful- 
filled. We distinguish the following cases: 

Case 1: Let s e (0, 1), (t,x) e S){+ x (9r\{0}), and suppose that there exists a 
positive integer p with s — Tp{t,x). Then, there exist positive integers m,l with 
I < p <m such that 

6>,„+i(f,x)>0 ei(t,x)>0 (6.51) 

s^Tm(t,x)^---^Ti(t,x)>0 (6.52) 

Equality (6.52), in conjunction with definition (6.39), means that 

0„,(f,x) = --- = 0/+i(f,x) = O ifm>/ + l (6.53) 

Notice that definition (6.47) and (6.51) imply that in our case, 

kis,t,x)^0 (6.54) 

By taking into account continuity of the mappings gi, gm+u Ti, T^ and (6.45), it 
follows that there exists S > such that 

, / 1 1 

s e lTi(r,y)- -gi{r,y),T,„(r,y)+ -g,„+i{r,y) 

W{s',r,y) e[0, 1] xS)i+ x (S)r\{0}) with \s' - s\ + \r - t\ + \y - x\ <8 

(6.55) 

By virtue of definitions (6.47), (6.48), (6.54), and (6.55), it follows that for every 
is',r,y)e[0,l] xJK+ x (9fr\{0}) with |i' - i| + |r - f| + |:y - jc| <S, 

\k(s',r,y)-k(s,t,x)\< max \uy\( ^'''■^'^'' ) ifm>/+l (6.56) 

v=l+i,...,m \s{r,y)2~^~'^ J 

k{s',r,y)^k(s,t,x) ifm = / (6.57) 

If m > /+ 1, then by (6.45) and (6.53) we also get ^„(f,x) = Ofori; = / + l,...,m; 
hence, since the mappings gv are continuously differentiable, there exists a constant 
L > such that 

max„=/+i,...,^g„(T,3;) 

<L\T-t\ + L\y-x\ 

e(t, y) 

V(r,y)eS}t+xS}r\{0}with|r-f| + |>'-x| <S (6.58) 
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It follows from (6.56), (6.57), and (6.58) that 

\k{s', r, 3;) - k(s, t,x)\< L'{\r - t\^ + \y - xp) (6.59) 

for some constant L' > and for \s' — s\ + \r — t\ + \y — x\ < S. We con- 
clude from (6.59) that the derivatives of k(-,-, ■) exist for s — Tp(t,x) and that 
|j(5, r, x) = §(s, f, x) = and j^{s, f, x) = for s = Tp{t, x). The latter, in con- 
junction with (6.50), implies that k(-, ■, ■) is continuously differentiable in a neigh- 
borhood of (s, t, x) with s — Tp(t, x) e (0, 1). 

Case 2: Let .v = 0, (t, x) e Dt"*" x (9t"\{0}), and suppose that there exists an integer 
p >0 with s — Tpit, x) — 0. Clearly, there exists an integer m> p such that 

0,„+i(f,x)>O (6.60) 

5 = 7;,(r,x) = --- = ro(f,x) = (6.61) 

(note again that equality (6.61) means that 6,„(t, x) — ■ ■ ■ — Oiit , x) — Q for the 
case m > 0). By virtue of definition (6.47), it holds that k(s, t,x) — 0. The con- 
tinuity of the mappings r,„ and gm+i implies that there exists ^ > such that 
s' e [0, Tmir, y) + \g„r+i{x, y)) for all {s' , x, y) e [0, 1] x 9J+ x (Sir\{0}) with 
\s' - s\ + \x - t\ + \y - x\ <S. Then as in Case 1, it follows from (6.47), (6.48), 
(6.49) that 

\k(s' ,x,y) — k(s,t,x)\ < max |mi,|I — '- ^| ifm>0 (6.62) 

v=l,...,m \e(T,}')2~"~"^/ 

k{s',x,y)^kis,t,x) ifm = (6.63) 

for every li'' — i'l + lr — fl + ly — x| < S, from which we get the desired conclusion, 
namely, that A:(-, ■, ■) is continuously differentiable in a neighborhood of (0, t, x) and 
that (6.25) holds. 

Case 3: Let s = 1, (t, x) e di~^ x (9{"\{0}), and let /? be a positive integer with s — 
Tpit, x). Let {^,}~ 1 be the locally finite open covering of (-1, +00) x (a{"\{0}) 
and the associated sequence of functions in such a way that (6.35), (6.36), (6.37), 
and (6.38) hold. Let A^ C (— l,+oo) x (M"\{0}) be a neighborhood containing (t,x) 
which intersects only a finite number of the open sets [i^ijfZi (^^^ [18]). Conse- 
quently, by (6.38) there exists an integer m > I such that N D i2i —0 for all / > m 
and Oj (t, y) — Q for all i > m and (r, y) e N. Clearly, there exists I e [l, . . .,m} 
with 

6»/(f,x)>0 (6.64) 

s^Ti(t,x) = ---^T,„(t,x)^l (6.65) 

Without loss of generality, we may assume that m > I. By virtue of definition (6.49), 
we have A:(l, f, x) = 0. This, together with the continuity of the mappings 7) and gj, 
asserts the existence of a constant S > such that 
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s' e(Ti(r,y)-^g,ir,y),l and (r,y)eN 

W{s',r,y)e[0,l] xdi+ x (9{"\{0}) with |/ - l| + |r - f| + |:y - jc| <8 

(6.66) 
Using (6.47), (6.48), (6.49), and (6.66), we get 



\k(s' ,r,y) — k(l,t,x)\ < max |mi)|(- 

' ^ ' ' v=l+l,...,m \t 



?v{r,y) 



,£(t, y)2-"-2^ 

from which it follows that (6.59) holds for all li'' — 1| + |r — r| + I}' — x| < 8 and for 
some constant L' > 0. This implies that the derivatives of k(-, ■, ■) exist for 5 = 1, 
and particularly, (6.26) holds. The latter, in conjunction with (6.50), implies that 
k{-, ■, ■) is continuously differentiable in a neighborhood of (1, t, x). 

We next establish (6.28). By virtue of (6.43), (6.45), and definition (6.47)-(6.49), 
wehavemax,sg[o,i] |^(.y, t,x)\ < max j(zj(t,x) \uj\. Jit, x) being the index set defined 
by (6.41). For every j e J(t, x), there exist {tj,Xj) e (-1, +oo) x (;H"\{0}) with 

\uj\ < /7(max(0, tj), Xj) (6.67) 

for which (t,x) e f2j and in such a way that (6.35) holds with i — j ■ The choice 
Sj — S{tj, Xj) < q(tj,Xj), in conjunction with (6.67) and definition (6.29) of ^(■, ■), 
implies (6.28). Finally, we estabUsh (6.27). Notice that by (6.41), (6.43), (6.46), 
(6.47), and (6.48), for any (t, x) e m+ x m"\{0} and integer j e Jit, x), it holds: 



k(s, t, x) — u j Ws e 



2 2 

Tj-iit,x) + -gj(t,x),Tj(t,x)--gj(t,x) 



when 9j(t,x) > s(t,x)2~-'~^ (6.68) 

Hence, the set I(t..x) '■— {■? £ [0> 1] • k{s, t,x) y^ u j, j e J(t, x)} has Lebesgue mea- 
sure, say |/(f,,i-)|, satisfying 

|/(r,..)l< E s(t,x)2-J-'<s(t,x) (6.69) 

jeJ{t,.K) 

Then, for any deMo, it follows by virtue of (6.32), (6.36), and (6.69) that 



dV ^ . 9V ^ 

— {t,x)-\ (f, 

dt dx 



x) j f(t,d(s),x,k(s,t,x))ds 
Jo 



3/ X / X dV 

< — [l — s(t,x))p(V(t,x)) + s(t,x) max max — (?,x) 

4' \u\<bit.x) deD dt 

ueU 

dV 

H (t,x)f(t,d,x,u) 

dx 

Inequalities (6.30) and (6.31), in conjunction with the above inequality, imply 

(6.27), and the proof is complete. D 

The next lemmas constitute key results of the rest analysis and generalize Lem- 
mas 2.8 and 2.9 in [12]. Their proofs are based on certain generalizations of the 
technique employed in [12]. 
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Lemma 6.2 Consider system (1.3) under the same hypotheses as those imposed 
in Lemma 6.1. For every function q e C (!){"*" x Dt"; Dt"*") satisfying (6.22) and for 
every pair of sets r — {r,- : / e Z} and a — {a,- : / e Z} with r,- > an(i «/ > 0, 

r,- + 2fl; < r/+i — 2fl/-|-i for all i e Z (6.70) 

lim ri — +oo lim r; = (6.71) 

i— >-+oo (■— >■— oo 

f/jere exwfs a continuous mapping kr^a ■ 9^^ x (9^"\{0}) -^ U, continuously differ- 
entiable with respect to x & 9{"\{0}, with 

dk 
k,.,aU, x)^0 and —^(j, x) = for all (x, j) e (a{"\{0}) x Z+ (6.72) 

\kr,a(t,x)\<bit,x) V(f,x)ei«+ X (S1{"\{0}) (6.73) 

where b(-, ■) is defined by (6.29), and such that the following property holds for all 
(to, XQ, d, i) e m+ X (a{"\{0}) y^Moy^Z: 

V(tQ,xo)e[ri-i,ri] =^ y{t,x{t,to,XQ;d))<ri + -ai 

for all t e [to, mm{[to] + 1, fmax)) (6.74) 

where x{-, to, xo', d) denotes the unique solution of 

i^f{t,d,x,kr,a(t,x)) it,x)em+ x{m"\lO}) (6.75) 

with initial condition x{to) — xo & 9J"\{0}, corresponding to d & Md, and fmax '■— 
trmix{to,xo,d) > to denotes its maximal existence time. Moreover, for each 
{xo, j, i) e (9i"\{0}) X Z"*" X Z, there exists a positive integer N >2 such that 

V(j,xo) <ri -2a/ 

^ ^(i + T^'^(./ + T^'i'-^oc?) j <max(r,_i +2ai-i,V(j,xo) - —fii 

s 
for all d e Md and .? e {0, 1 , . . . , A'} with j -\ < fmax (6.76) 



where 



1 , , 

p,i := -mvi\[p{s) : s e [r,_i,r,]} (6.77) 



Proof Let q e C°(i)J+ x dl"; dl+) be a function satisfying (6.22), and k : [0, 1] x 
9t+ X (m"\{0}) ^ U aC^ function which satisfies (6.24), (6.25), (6.26), (6.27), 
and (6.28) and whose existence is guaranteed by Lemma 6.1. For / e Z and j e Z"*", 
define 

Qij = {{t,x) e [j,j + 1] X m" : Vit,x) e h_i,r,]} (6.78) 

Pi := min(a,_2, ai_i,ai,ai+i) (6.79) 

and select 8ij > satisfying 
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dV 
„ it,x)- ^—{to,xo) 
at at 



+ 



9^. ^ 9y^ 

ax ax 



dV 



dx 



(fo,JCo) 



max[\f(t,x,d, u)\:d e D,u eU,\u\< b{t,x)] 
[\f(t,d,x,k{s,to,x)) 



- f [to, d , xo,k{s , tQ, xq))\ : i e [0, l],d e D} 
<-p{V(to,xo)) 

V(ro, xo) e Qij,y(t, x) e SR+ X (SR"\{0}) with t e [to, to + Sij], \x - xo\ < Sij 

(6.80) 

Also, let N/j e Z"*" with Njj > 2 be a family of integers which satisfies the follow- 
ing inequalities: 



4 max 



dV dV 

-—(t, x) + -—{t, x)f{t, d, X, u) 
at ax 



■.te[j,j + 2],V{t,x)e[ri-i,ri+2\, 

(6.81) 



d eD,ueU,\u\< b(t,x) \ < p/Nij 

2 + 2max{|/(f, d,x,u)\:te [j, j + 2], V(t, x) e [r,_3, n+2], 

deD,ueU,\u\< b(t, x)} < SijNj^j (6.82) 

Consider next a smooth nondecreasing function h :di ^S' [0, 1] with h(s) — for 
s < and /!(s) = 1 for .y > 1 and define the desired kr,a : 9J+ x (9J"\{0}) ^ U as 
follows: 



'^r,a yt ^ X) 






(t,x) e ^ij,t e 



I I+l 

J + T^J ' 



Nij 



N, 



I, J 



(6.83) 



for some / e {0, 1, . . . , Njj — 1} 

Obviously, (6.73) is a consequence of (6.28), (6.29), and (6.83). Moreover, by tak- 
ing into account (6.24), (6.25), (6.26), and (6.70) it follows that ^r,fl('. above is 
continuous, continuously differentiable with respect to x e 9{"\{0}, and satisfies 



kr,a(j,x)^0 



dx 



-(;,x) = V(x,;■)e(9i"\{0})xZ^ 



(6.84) 



Let {xo,d) e (m"\{0}) x Md and to e [j + jJ-J + 7^) for some / e {0, 1, 
.■■,Nij - 1} with 

y(fo,xo)e[r,_2,r;+i] (6.85) 
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Then, by (6.81), (6.82), and (6.85), it can be easily established that, for all t e 

(6.86) 



[fo,; + 7^],itholds 



t — to + \x(t, to, xo', d) — xo\ < Si J 

1 

V(to,xo)- -min(a,_i,fl,) 

< V{t,x(t,to,xo;d)) < V(to,xo)+ -min(fl,_i,a,) 



(6.87) 



In fact, suppose on the contrary that there exist (xq, d) e (!W"\{0}) x Mo, to e [j + 



J-,j + !^)forsomsle{Q,l, 

such that either (6.86) or (6.87) does not hold and consider the closed set 



, Ni^ / - 1 } satisfying (6.85) and t e[to,j- 



l+i 



A:= 



T e 



to, J 



l + l 



: max 



2\V{r,x(r,to,xo;d)) - V(to,xo)\ 



min(a,_2,fl,-i,fl,-,fl,+i) 
r — to + \x(r, to, xo; d) — xo\ 



> 1 



Notice that, since t e A, the set A is nonempty. Let fi :— min A. Clearly, since 
to ^ A, it holds that ti > to- Definition of the set A above, (6.70), and (6.85) imply 
that y (r, x(r, to, xo; d)) e [r,_3, r,+2] for every r e [to, ?i). It follows from (6.73), 
(6.81), and (6.82) that 



dr 



V(T,x(r, to,xo; d)) 



1 

< -piNi^j and 



2 + 2\x{r)\<&ijNi,j a.e. for t e [fo, fi) 

which, in conjunction with definition (6.79) and the fact that r — to < 
that, for all r e [fo, fi], we would have 

\v[r,x(r,to,xo;d)) - V(to,xo)\ 



N,.j 



implies 



Jtn dS 



ds < - min(a/_2, fl(-i, fl; , flf+i) 



T — f + \x{r, to,xo; d) — xo\ < t — to ■ 



Jtn 



{s)\ds<-Sij (6.1 



The previous inequalities for r — ti are in contradiction with the fact that ti e A. 

In order to establish properties (6.74) and (6.76), we first need the following 
properties: D 



Property 6.1 Let d e Md, and let 

I 

V{to,xo) e [r,_i +ai-\,ri 



to^J 



/e{0, 1, 



Nij-l] 
-2a,l 



(6.89) 
(6.90) 
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Then the following inequality is fulfilled: 



1+1 f 1+1 I 
0< Vl/H ,x{ j -\ ,j-\ ,xo;d 



<V(; + ^,xo 



1 



4Nij 



p{y{j 



I 



N, 



-,xo 



'■J 



(6.91) 



Proof Using (6.87) and definition (6.83), it follows that 



kr,a{t,x(t,tQ,XQ\ d)) —ki Nijit - j) - I, j + ——,x(t,to,xo; d) 1 



Vf e 



I /+1 



Nl 



N, 



'■J 



(6.92) 



For convenience, let us denote here h :— -J—, x(-) — x(-, to, xq; d) and d{t) 
d(to + ht) (notice that d e Mo)- From (6.92) we have 

V{to + h,x(tQ + h))-V(to,XQ) 

f'o+hrQv , 
= / — T,x(r 



/ 



Li^ 



-(T,x(r)) 



dV , , / /r-?o 

+ — (t, x(r))/( r, d{r), x{r),ki—^, to, x(r) 



dr 



Jo 



dV , . dV , . 

-^—(tQ + hs,x(tQ + hs)) + -^:—(to + hs,x{to + hs)) 
dt dx 



X f{to + hs, d{to + hs), x(fo + hs), k[s, to, x(to + hs))) 
Jo 



dv dv , - ■ 

--(fo, xo) + -^—(to, xo)f{to, d(s), xo, k{s, to, xq)) 
dt dx 



ds 



ds 



'f 

Jo 

•f 

Jo 



av . . dv 

-^—{to + hs,x(to + hs)) - --(fo,xo) 
of at 

av , . av 

-:—[tQ + hs,x(tQ + hs)) - -— (fo,xo) 
dx dx 



ds 



X /(fo + hs, d(s), x(to + hs), k[s, to, x(fo + hs)jf ds 

/> 1 O T/ 

+ h -—ito,xo)[f{to + hs,d(s),x(to + hs),k{s,to,xito + hs))) 

Jo ax 

- /(fo, d{s), xo, k(s, to, xo))] ds (6.93) 

Using (6.27), (6.28), (6.80), (6.86), (6.87), (6.89), (6.90), and (6.93), we get the 
desired (6.91), and the proof of Property 6. 1 is complete. D 
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The next property is a consequence of Property 6. 1 : 
Property 6.2 Suppose that 

Q<vij + ,Jco) <r,-2fl; forsomele{0,\,---,Ni^j-\} (6.94) 

and assume that the solution of (6.15) with initial condition x(j + jt—) — xq e 
9J"\{0}, corresponding to some d e Mo, exists for t e [j + jj—, j + -^r]- Then 

( /+1 / Z+l / 
0< V /H ,x\ /H , /H ,xo;(i 

<max r,_i+2a,_i, V( j + T^.-'^o) " T^"'^' I ''^"^^'' 

where [li > w defined by (6.77). 

Proof Obviously, the desired (6.95) is a consequence of (6.91), provided that (6.90) 
is fulfilled. Consider the remaining case 

0<v(j + ^,xo\<ri_i+a^_i (6.96) 

We show by contradiction that, when (6.96) holds, then 

/ Z+l / Z+l / \\ 

0<y(y + — ,.(;■ + — ,; + —,xo;./jj<.,_:+2o,_, 

Indeed, suppose on the contrary that 

/ Z+l / Z+l / w 

y(y + — ,x(^; + — ,; + — ,xo;.jj>.,_t+2«,_i (6.97) 

Then, there would exist fi e (/' + -J—, j + ^r-!-) such that 

( ( ^ \\ 3fl/-i 
V\t\,x\ty,i + ——,XQ;d\ I =r,_i H — 

Using (6.87), the latter implies 

/ Z+l / Z+l Z w 

0<y(; + — ,0(y + — ,;• + — ,xo;.jj<._t + 2a,_, 

which contradicts (6.97), and the proof of Property 6.2 is complete. D 

The following property is a direct consequence of Property 6.2 and (6.70): 



Property 6.3 Suppose that (6.94) holds and assume again that the solution of (6.75) 

I 

N..J 



with initial condition x(J + -w— ) — xq e Dt"\{0} corresponding to some d e Mo 
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N,.j 



l+s 



j + ^^]for certain 5 e {0, 1, 2, 



JV, 



'•./ 



■ /}. Then 



l+s / l+s I 
0<V{ j -\ ,x j -\ J -\ ,xo;d 



< max 



r,_i +2a,_i, V[ j + -Tj—'^o 



NiJ 



fii 



(6.98) 
(6.99) 



The desired (6.76) follows from Property 6.3 with I — 0, N — Nij. We next 
proceed with the proof of (6.74). Combining Property 6.3 with (6.87), we obtain the 
following: 

Property 6.4 If (6.94) is fulfilled, then 



o<y f,x t,i 



I 



, xo; d 



< max 



Vre 



r,_i +2a,_i, V{ j 
I 



I 



N, 



min(fmax, j + 1) 



, xo 



1 



'■J 



l+s 
N,.j 



< t„ 



Proof Let .J e {0, 1, 2, ... , M,/ - / - 1} with j 
we distinguish the following two cases: 

Case 1 : Suppose that 

/ l+s / l+s I 

V\ j -\ ,x j -\ ,j-\ ,XQ\d >r,_i 

V Nij V Nij Nij " - < 1 

Then by invoking (6.87), from (6.98) and (6.101) we get 



■min(a,_i, a,) 

(6.100) 
By virtue of (6.98), 



(6.101) 



0< V{t,x{t,j 



I 



Ni 



, Xo; d 



i-j 



1 



min(fl,_i, a,) 



(6.102) 



<max{r,-i+2a,_i, V[ j + 7^,xo 

„ r. l^+s ■ ' + .S+1 
L Nj Nij 

The desired (6.100) is a consequence of (6.102). 

Case 2: Suppose that 

/ l+s ( l+s I 

0<^L/ + T^'-^W + T^.7 + T^.^o;fl' <n-i (6.103) 



Ni,i 



N 



'J 



Nij 



We show by contradiction that, when (6.103) holds, then 

/ 



y( t,x( t,j + ——,xo;dj 1 <r,_i +2a/_i 
l+s . ( . 1+S+ 1 



1 



min(a,_i, a,) 



Vre 



7 H , mm 

.' Nij 



I Anaxj ] 



Nij 



(6.104) 
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If (6.104) were false, then there would exist t e [j + ^, min(fmax. j + '-j^)) 
such that 



■2a/_iH — min(a/_i, fl/) (6.105) 



Vlt,xlt,j + ——,xo;dj 1 >r,_i 

By (6.103) and (6.105), there would exist fi e [; 
that 



I+s 



,min(?max,;' + 



l+s+l 



)) such 



V\ fi,x| h,j + -——,xo;d I I =r,_i 



■ 2a 



;-l 



y 1 1, x| t, j + ^, -^o; d]]< n-i + 2a,-i 



By (6.106) and (6.87) we get 



J + ^^'h 



Ni, 



(6.106) 



——,xo;d] j <r,_i +2fl,_i + -min(fl,_i,a,) 



'.J 



ri,min(fniax,; 



/ + ^+l 



Af; 



'.7 



(6.107) 



Combining (6.106) and (6.107), we obtain < V(^, x(|, j + ■J-,xo; d)) < r,_i 



N,J ■ 



,_i + i min(a,_i , a,) for all f e [; + ^ , min(fmax, ; + ^^y-))' which contra- 



2a - ' 1 

diets hypothesis (6.105) 

We conclude from (6.102) and (6.104) that in both cases above we have 



0< V(t,x(tJ 



I 



N, 



-,xo; d 



i-j 



< max 



r,_i +2a,_i, V\ j + -rf—,X(i 



1 



■ min(fl,_i, fl,) 



l+s 



l+s + l- 



for every t e [j + ^, min(?max, j + -W^)) and for all i' e {0, 1, 2, . . . , Ni ,■ - 



/-I} with; - 



i±l_ 



< tm-dx, and the latter implies the desired (6. 100). This completes 



the proof of Property 6.4. 



D 



We are now in a position to establish (6.74). Let (xQ,d) e (Br\{0}) x Md 
and ro e [; + ^v^' J + ^TT^ ^°^ ^°™^ / e {0, 1, . . . , Nij - 1} with V(to, xq) e 
[r,_i, r,]. Then, exploiting inequality (6.87), we obtain 



1 / N 1 

Vito, xq) - -ai < V[t, x(t, to, XQ- d)) < V (ro, xq) 



-ai 

2 



Wte 



to, j 



l+l 



N, 



•+hjJ 



(6.108) 
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Since r, + jA,- < /",+i — 2a,-i_i, by virtue of (6.108) and (6.101) of Property 6.4, 
we get < Vit, (p(t, to, xq; d)) < r,- + |a/ for all t e [Iq, min(finax. j + 1))> and this 
establishes (6.74). The proof is complete. D 

Lemma 6.3 Under the same hypotheses imposed in Lemma 6.1 for system (1.3), /or 
every function q e C (Dt"*" x (JH"; JH"*") satisfying (6.22), f/zere exw/5 a continuous 
mapping k : Dt"*" x (S){"\{0}) —>■ U, continuously differentiable with respect to x £ 
9{"\{0}, which satisfies 

\k{t,x)\<b{t,x) V(f,x)e;)i+x (9i"\{0}) (6.109) 

where b{-, ■) is defined by (6.29), and such that the following property holds for all 
(to, xo, d) e *){+ X (9r\{0}) X Mo- 

V{t,x{t,to,XQ\d))<9V{to,xo) Vf e[fo,min([ro] + 2,rmax)) (6.110) 

where x{-,tQ,X{)\d) denotes the unique solution of 

i^f{t,d,x,k(t,x)) (t,x)em+ x{m"\lO}) (6.111) 

with initial condition xito) — xq e ^"\{0}corresponding to d E Mo, and fmax '■— 
WdxitQ, XQ,d) > ^0 denotes its maximal existence time. Moreover, there exists posi- 
tive definite p e C (di~^; Si"*") with p(s) < s for all s >0 such that 

V{2j + 2,x{2j + 2, 2j, xo; d)) < V{2j, xq) - p{V{2j, xq)) 
for all (xo,d,j)e {m"\{0}) x Md x Z+ with 2j + 2< f^ax (6. 1 12) 

where fmax > 2j in (6.112) is the maximal existence time of the solution 
x(-,2j,xo;d) of (6.111). 

Proof Let q e C°(S)t+ x !){"; S)t+) be a function satisfying (6.22) and let r = {r; : ( e 
Z} be a set with r,- > and such that 



r;_|_i < 2r,- and lim r,- = +oo lim ri—0 (6.113) 

('— >- + oo I— >■— oo 



Consider the set 



, f , n + n+i . 1 

r = \r- — : I e Z) 

I' 2 1 



(6.114) 



which by virtue of (6.1 14) satisfies r'^ > and, further, 

rLi<2r'i and lim r-^+oo lim r-^0 (6.115) 

Define 

fii := - min{p (.?):.? e [r,_i,r,]} /a- := -min{p(s) : i' e ['■■.i-r,']} (6.116) 
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and let a — {a,- : ; e Z}, a' = {a'- : ; e Z} be a pair of sets satisfying: 

a,>0 a[>Q (6.117) 

r; + 2a,- < r,+i - 2fl,+i r- + 2fl- < r,'_^j - 2fl-_^i (6.1 19) 

ai + a[ < '+' ai + a'._^ < ' (6.120) 

o o 

at < Y fl; < — -— (6.121) 

By Lemma 6.2, there exist continuous mappings ^,-a : di'^ x (jy{"\{0}) —>■ U and 
kr',a' ■ 3t+ X (M"\{0}) -^ U, continuously differentiable with respect to x e iW"\{0}, 
with 

kr,a(J, ^) = ^.',«'(;, X) = V(x, 7) e {di"\{0}) X Z+ (6.122) 

^{j,x)^^^(j,x)^0 V(x,;)e(!){"\{0})xZ+ (6.123) 

and such that properties (6.73), (6.74), and (6.76) hold . Finally, consider the map 
k:m+ X (S1{"\{0}) -^ U defined as 

\lcr',a'(t,x) forfe[2j + l,2j+2),(j,x)eZ+x(Sr\{0}) 

By taking into account (6.122), (6.123), (6.124), and regularity properties of 
kr,a{-, ■) and kr\a'i': ■)> it follows that k(-, ■) is continuous, continuously differen- 
tiable with respect to x e ;)i"\{0}, and satisfies 

~k(j,x)^0 V(7,x)eZ+xOr\{0}) (6.125) 

Moreover, (6.109) is an immediate consequence of definition (6.123) and in- 
equality (6.73). Also, by (6.74), (6.113), and (6.118) it follows that for every 
{to, XQ, d, i) e m+ X (a{"\{0}) X MdxZ, it holds: 

V(to,xo)e[ri-i,n] =^ V{t,Xr,a(t,to,xo;d))<3V(to,xo) 

for all t e [to, min([fo] + 1, t';^^^, )) (6.126) 

V(to,xo)e[n-i,n] =^ v{t,Xrry(t,to,xo;d)) <3V(to,xo) 

for all t e [to, min([fo] + 1, r,;-^')) (6.127) 

where Xr,^ (■, fo, xq; d) denotes the (unique) solution of 

k^f{t,d,x,krAt,x)) (f,x)e9t+ X (9r\{0}) (6.128) 

and x>' a'(-, to, xq; d) is the (unique) solution of 

Jc^f{t,d,x,k,.',a'it,x)) (t,x)em+ x{m"\lO}) (6.129) 

with same initial condition x(?o) = xq e 9i"\{0} and d e Mu, and f^ax > fo and 
fmax > to, respectively, denote their maximal existence times. The desired inequal- 
ity (6.110) is a direct consequence of (6.126), (6.127), definition (6.124), and the 
following obvious fact. 
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Fact The solution of (6.111) with initial condition X (to) —xq^. D{"\{0} correspond- 
ing to some d e Mq is identical for t e [fo,mm([fo] + l,fmax)) to the solution 
Xr,a(tjto^^o\d) o/ (6.128) if [to] is even and is identical for t e [?0) iTiiii([?o] + 

r' a' 

1, tfam )) to the solution x^'a'it, to, xq; d) 0/(6.129) if{to\ is odd. 

In order to show (6.112), let (xo,d,j) e (9r\{0}) x Md x Z+ be such that 
the unique solution x(-, 2j, xq; d) of (6.111) with initial condition x{2f) — xo & 
3{"\{0}, corresponding to c? e Md is well defined on {2j, 2j + 2]. Notice that, if 
there is no such (xq, d, j) e (S){"\{0}) x Md x Z"*", then property (6.112) trivially 
holds for every positive definite function p e C^(di'^; St"*"). Let / e Z be the smallest 
integer with 

r,_i - 2fl,_i < V(2j, xo) < ri - 2fl,- (6.130) 

whose existence is guaranteed by (6.113) and (6.119). By virtue of (6.76), (6.130), 
and the previous fact, it follows that 

V{2j + \,x{2j + \,2j,XQ\d)) <max(r,_i +2a,_i, V{2j,xq)- im) (6.131) 

Notice that, by (6.120) we have V{2j + l,x{2j + 1,2;, xq; d)) < r[ - 2a\. Conse- 
quently, there exists an integer k < i with 

r'^-i - 2a^_i < V{2j + \,x{2j + 1, 2;, xq; d)) < ^ - 2^ (6.132) 

We distinguish the following cases: 

Case 1: k < i 

In this case it follows from (6.132) that V{2j + 1, x(2; + 1,2;, xq; d)) < r'._^ - 
2a'. _y. By virtue of (6.76) and the fact above, we then obtain 

y(2;+2,x(2;+2,2;,xo;c;)) 

< max(r,'_2 + 2fl,'_2, V(2j,xq) - fi'i_^ -/x,-,r;_i -t-2fl;_i - f^'i_i) (6.133) 
We now take into account (6.120), which implies 

/ / 0-1 — '"('-2 

r,_2 + 2fl,_2 < r,_i - 2a,_i (6.134) 

From (6.133), (6.134), and the left-hand side inequality in (6.130) we get 
V{2j + 2,x(2j + 2,2j,xo;d)) 

< V(2j, xo) + maxj"- ""'"^ ~ "'^ , 4a,-i - i^\^ (6.135) 

which by (6.121) implies 

y(2;+2,x(2;+2,2;,xo;flf)) 

< y(2;,xo)- -min(r,_i -r,_2,2At;_i) (6.136) 
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Notice that, since r'-_^ — 2a'._y > r,_i + 2fl,_i (which is a consequence of (6.120)), 
from (6.131) and using the left-hand side inequality (6.132) with k — i,we conclude 
that 

r;_i - 2fl;_i + fii < V(2j, xq) (6.137) 

Also, by (6.76) and the fact above we get V(2j + 2,x(2j + 2,2j,xo; d)) < 
max(r^'_j + 2flj'_j, V(2j, xq) — H-'i — fJ-i), which, in conjunction with (6.137), gives 

V{2j + 2, x(2j + 2, 2j, xq; d)) < V(2j, xq) + 4a-_y - /x,- 
which, in turn, by virtue of (6.131), implies 



V{2j + 2, xi2j + 2, 2j, xo; d)) < V{2j, xq) - -in 
We conclude from (6.136) and (6.138) that in both cases we have 

r,_i - 2<3,_i < V(2j, xo) < ri - 2a,- 

^ V{2j + 2, x(2j + 2, 2j, xo; d)) < V(2j, xq) - Yi 

1 

_2,2/x;_j,2/x,) 



Yi := -min(r,_i -r,-. 



Now let 



Ks) 



(min(y,-.y, + i)-min(y,-_i,y,))(.y-f,-_i+2a,_i) 
(r,-2a,-r,_i+2a,_i) 



min(y,_i,y,) 



fori e (r/_i 
for s^Q 



2ai-\,ri -2fl,] 



(6.138) 



(6.139) 
(6.140) 



(6.141) 



Notice that (6.116), (6.140), and (6.141) imply that < min(y,_i, y,, yz+i) < 
pis) < Yi for s e (r,_i — 2a,_i , r,- — 2a,] and further lim/^_cxD /U., = lim/^_oo M; = 
lim,-^_oo K, — 0. Thus, we may easily verify that p : di~^ -^ Oi"*" is positive definite 
and continuous. Finally, define 



p{s) 



\{p(s), 



(6.142) 



Property (6.139)-(6.140), in conjunction with (6.141), implies that the desired 
(6. 1 12) is satisfied, and the proof is complete. D 

We are now in a position to prove Theorem 6.1. 

Proof of Theorem 6.1 According to the statement of Lemma 6.3, for every func- 
tion q e C*'(9{"'" X 9{"; Dt"*") satisfying (6.22), there exists a continuous mapping 
ic : 9J+ X (9i"\{0}) -^ U, continuously differentiable with respect to x e ^H"\{0}, 
which satisfies (6.109), (6.110), and (6.112). Define 



K(t,x):^h 



V(t,x) -exp(-f)\ - 



exp(-f) 
Kit,x):^0 fory(f,x)<exp(-f) 



k(t, x) for y (r, x) > exp(-f) (6.143) 

(6.144) 
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where h :di ^ [0, 1] is a smooth nondecreasing function with h{s) — for s < Q 
and /; (5) = 1 for i > 1 . It can be easily verified that, according to definitions (6. 143), 
(6.144), and the properties of ^ : ;H+ x (i)i"\{0}) -^ U, the map K takes values in U 
and satisfies K(t,Q) — Q for all f > 0. Moreover, K : di~^ xdi" —^^ U isa continuous 
and continuously differentiable mapping with respect to x e !1t"on Di"*" x dV. 

In order to prove Theorem 6.1, we will make use of Lemma 6.3 and three facts 
below concerning certain properties of the solution of the closed-loop system (1.3) 
with u — K(t, x). Let 

T — T{to,xo,d) 

\ M{t > to : exp(t)V(t,x(t)) < 2} if {f > to : exp(t)V(t,x(t)) < 2} / 
"~ I +00 if{f > fo : exp(t)V(t,x(t)) < 2} = 

(6.145) 

where x(-) — x{-,to,xo;d) denotes the unique solution of the closed-loop sys- 
tem (1.3) with u — K(t, x) and initial condition x(to) — xq e M" corresponding to 
some d e Md- The following fact is an immediate consequence of (6.143), (6.144), 
(6.145), and the continuity of the mapping t —>■ V{t, x{t)). 

Fact 1 The unique solution x(-) — x(-,to,xo',d) of the closed-loop system (1.3) 
with u — K{t,x), initial condition x{to) — xq & 9{"\{0}, satisfying V{to,xo) > 
2exp(— fo), corresponding to some d e Mo coincides with the unique solution 
0/(6.111) with the same initial condition and the same d e Mo on the interval 
[to, r], where T — T(to, xo, d) is defined by (6.145), and 

V{T,x(T))^2expi-T) if {t >to: exp(t)V{t,x(t)) <2} ^0 (6.146) 

Next, we prove the following: 

Fact 2 For the closed-loop system (1.3) with u — K(t,x), the following property 
holds for all (j, xq, d) e Z+ x M" x Mo- 

V{2j + 2,x(2j + 2,2j,xo;d)) 

< V(2j,xo)-p{V(2j,xo)) + 18exp(-2y) (6.147) 

Proof Obviously, the desired (6.147) holds for xo = 0. Next, assume that xo ^ 0. 
Let fjnax > 2y be the maximal existence time of x(-, 2j, xo', d). We distinguish two 
cases. The first case is 



{t e [2j, min(rniax, 2; + 2)) : exp(t)V{t, x(t, 2j, xo; d)) < 2} = (6.148) 

In this case. Fact 1, in conjunction with inequalities (6.1 10) and (6.1 12), guarantees 
that fmax > 2_/ -|- 2 and that (6.147) holds. The second case is 

[t e [2;,min(Wx, 2j + 2)) : exp(t)V{t,x(t, 2j,xo; d)) < 2} / (6.149) 

Let 

ti :=sup{f e [2y, min(fmax, 2; -I- 2)) : exp(r) V(f,x(f, 2;, xq; (i)) < 2} (6.150) 
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Clearly, from (6.150) we have 

sup exp(t)V[t,x(t,2j,XQ;d))<2 (6.151) 

which, by virtue of (6.20), implies fmax > ti. If ti — 2j + 2, the desired (6.147) 
follows from (6.151). If fi < 2; + 2, (6.150) guarantees that e\p(t)V{t,x(t,2j, 
xq', d)) > 2 for all t e [ti,min(tyaa^,2j + 2)), and the latter, in conjunction 
with (6.151), gives 

expiti)V{ti,x(ti,2j,xo;d)) =2 (6.152) 

Using Fact 1 together with (6.110) and (6.152), we get V{t,x(t,2j,xo; d)) < 
18exp(— ri) for all t e [fi,min(fiiiax,2y + 2)). By exploiting (6.20) we conclude 
that f,jiax > 2j + 2, and therefore the estimate V{t,x{t, 2j, xq; d)) < 18 exp(— ri) is 
fulfilled for every f e [fi, 2] + 2]. The latter implies (6.147), and this completes the 
proof of Fact 2. D 

Finally, we show the following fact. 

Fact 3 The following property holds for the closed-loop system (1.3) with u — 
K{t,x): 

V{t, x(t, to, Xq; d)) < 9V(to, xq) + 18 exp(-ro) 
for all t e [to, [to] + 2], (fo, xq, d) e di+ x !H" x Md (6.153) 

Proof Obviously, (6.153) holds for xq — 0. Suppose next that xq ^ and let us on 
the contrary assume that there exists t e [to, [to] + 2] with 

V{i,x{i,to,xo;d))>9V{to,xo)+mexp(-to) (6.154) 

We distinguish two cases. First assume that 

{s e [to,i] : exp{s)V [s , x(s , to, xo; d)) < 2} = 

In this case, (6.1 10) guarantees that V(t, x(i, to, xq; d)) < 9V(to, xq), which contra- 
dicts (6.154). Consider the remaining case 

{s e [to,t] : exp(s)V [s , x{s , to, xo; d)) < 2} / 

and let rj :— sup{s e [to, i] : exp(s)V(s, x{s, to, xq; d)) < 2). If ti — i, we would 
have V{i,x(i,to,xo; d)) < 2exp(— fo), which contradicts (6.154). If ti < i, then 
we would have sxp(s)V{s, x{s, to, xo; d)) > 2 for all s e [t\,t] and exp(fi)V'(fi, 
x(fi,27,xo; d)) — 2. Therefore (6.1 10) gives V(s, (p(s,to,xo; d)) < 18exp(— fi) for 
all s e [fi, i], which again contradicts (6.154), and we conclude that (6.153) holds. 
This completes the proof of Fact 3. D 

Inequalities (6.147) and (6.153), in conjunction with Proposition 2.5 in Chap. 2, 
show that the closed-loop system (1.3) with u — K{t, x) is RGAOS. By invoking 
definition (6.143)-(6.144) we obtain 

|/s:(f,x)| < |^(r,x)| V(f,x)e9i+ X (!H"\0) (6.155) 
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where k : Dt"*" x (S){"\{0}) —^Uh the continuous mapping whose existence is guar- 
anteed by Lemma 6.3. Combining definition (6.29) of b{-, ■), (6.109), and (6.155), 
we get, for all (t, x) e m+ x (i)J"\0), 

\Kit,x)\ <miix{b(r,y):(r,y)em+ x ^)i" ,\r - t\ + \y - x\ < q(r, y)} (6.156) 

It follows from (6.23) and (6.156) that the following inequality holds for all (f , x) e 
di+ xdl": 

\K(t,x)\<a{V(t,x)) (6.157) 

Define ais) :— a(s) + aj~ (s), where ai e K^ is defined in (6.20). Taking into 
account inequalities (6.20) and (6.20), the following inequality holds: 

a-^{\K{t,x)\ + iJi{t)\x\)<Vit,x)<a2{^{t)\x\) V(f , x) e 9i+ x 9i" (6.158) 

where 02 e Koo and fi, fi e K^ctre the functions involved in (6.20). Inequali- 
ties (6.147), (6.153), (6.158), in conjunction with Proposition 2.5 in Chap. 2, guar- 
antee that the closed-loop system (1.3) with u — K(t, x) and output Y — K(t, x) is 
RGAOS. 

The proof is complete. D 



6.6.2 Control Systems Described by ODEs: The Artstein-Sontag 
Approach 

This methodology is based on the following idea: given a CLF, design a feedback 
law so that the time derivative of the CLF along the solutions of the closed-loop 
system becomes negative definite. 

Using this methodology in his pioneering work [2], Artstein studied the above 
existence problem for affine autonomous control systems without disturbances, 
U c 3i'" being a closed convex set and output Y being identically the state of the 
system, i.e., H(t,x) = x (see also [67]). He showed in [2] that the existence of a 
time-independent Control Lyapunov Function (CLF) satisfying the "small-control" 
property is a necessary and sufficient condition for the existence of a continuous 
stabilizing feedback. Sontag [62] extended the results by presenting an explicit for- 
mula of the feedback stabilizer for affine autonomous control systems without dis- 
turbances, U — di"' and output Y being identically the state of the system. Sontag's 
formula was exploited recently in [29] for the uniform stabilization of time-varying 
systems. Freeman and Kokotovic [14] extended the idea of the CLF in order to 
study affine control systems with disturbances, U c di'" being a closed convex set 
and output Y being identically the state of the system, i.e., H(t,x) = x; they intro- 
duced the concept of the Robust Control Lyapunov Function (RCLF). In [36] the 
authors showed that the "small-control" property is not needed for nonuniform in 
time robust global stabilization of the state {Hit, x) = x) of control systems affine 
in the control with U — !1t"' . The result was extended in [35] for the general case 
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of output Stability. In all the above works the stabilizing feedback is constructed us- 
ing a partition of unity methodology or Michael's Theorem (when the continuity of 
feedback laws suffices). 

In this section, we consider control systems of the form (1.3) under the following 
hypotheses: 

(HH2) The vector fields / : SR+ x D x SW" x [/ ^ SR", // : M+ x M" -^ JR* are 
continuous, and for every bounded interval / C ^H"*" and every compact set S C 
di" X U, there exists L > such that 

\f(t,d,x,u) - f{t,d,y, v)\ + \H{t,x)- H{t,y)\ 

< L\x - y\ + L\u - v\ for all it,d) e I x D, (jc,m) e S, {y, v) e S 

Moreover, the set D C 9J' is compact, and U c 9J"' is a closed convex set. 

We next give the definition of the Output Robust Control Lyapunov Function 
for system (1.3). The definition is in the same spirit with the definition of the no- 
tion of Robust Control Lyapunov Function given in [14] for continuous-time finite- 
dimensional control systems. It should be noticed that the following definition of 
an ORCLF is different from Definition 6.1. Recall the definition of the Dini deriva- 
tive yO(f , x; v) := limsup,,^o+ ^^'+''-'+'1"^-^^'''^^ for all (f , x) e m+ xdi",vem" 
(see (2.128) in Chap. 2). 

Definition 6.2 We say that (1.3) admits an Output Robust Control Lyapunov Func- 
tion (ORCLF) if there exists a locally Lipschitz function V : iW"'" x di" —>■ di~^ (called 
the Output Robust Control Lyapunov Function) that satisfies the following proper- 
ties: 

(i) There exist ai,a2& Koo and P, ij.^ K'^ such that (6.20) holds. 

(ii) There exists a function ^f : J)i+ x J){" x [/ ^ Dt U {+00} with ^{t, 0, 0) = 
for all r > 0, a function q e £, and a C'^ positive definite function p : Dt"*" -^ 
Sit"'" such that for each u e U, the mapping (t, x) -^ ^{t, x, u) is upper semi- 
continuous, and the following inequality holds: 

mf^(t,x,u)<q{t) V(f,x)eS1{"^ xSir (6.159) 



Moreover, for every finite set {mi, uj, ■ ■ ■ , Up] C U and for every A,- e [0, 1] 
(i = 1, . . . , p) with Yl'i=i '^/ = 1> it holds that 

sup V'^\t,x\ f\ t,d,x,y^ XiUi I 1 

< -p{V(t, x)) + max{tf'(f, X, «,), i = l,...,p} V(f , x)em'^ x S1{" 

(6.160) 

For the case H(t, x) = x, we simply call V : Dt"*" x J){" -^ Sit"*" a State Robust 
Control Lyapunov Function (SRCLF). 
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We are now ready to state and prove our main results for the finite-dimensional 

case (1.3). 

Theorem 6.2 Consider system (1.3) under hypotheses (Hl-4) and (HH2). The fol- 
lowing statements are equivalent: 

(a) There exists a C^ function fc : SW+ x *){" ^ C/ with k(t, 0) — Ofor allt >0 such 
that the closed-loop system (1.3) with u — k(t, x) is RGAOS. 

(b) There exists a C function k : S)}"*" x 9J" -^ U with f(t,d,x,k(t,x)) being 
locally Lipschitz with respect to x and f{t, d, 0, k{t, 0)) — for all {t, d) e 
St"*" X D such that the closed-loop system (1.3) with u — k(t, x) is RGAOS. 

(c) System (1.3) admits an ORCLF. 

Theorem 6.3 Consider system (1.3) under hypotheses (Hl-4) and (HH2). Assume 
that system (1.3) admits an ORCLF, which satisfies inequality (6.20) with P{t) = 1 
and inequality (6.159) with q{t) = and that the following hypothesis holds: 

(HH3) There exist functions rj e K'^ and cp e C(A; U), where d e {1, 2, . . .} and 
A — Uf>o{^} X {x e?li" : \x\ < 4r]{t)}, with (p(t, 0) = Ofor all t > 0, such that 

'l'{t,x,(p(t,x))<0 for all {t, x) edi'^ xdi" with \x\<2r](t) (6.161) 

Then, there exists a mapping k : di~^ x S){" — >• [/ of class C"(^i'^ x Df ; U) with 
k{t, 0) — Ofor all t >0 such that the closed-loop system (1.3) with u — k(t, x) is 
URGAOS. 

Finally, if the ORCLF V and the function ^ involved in property (ii) of Defini- 
tion 6.2 are time independent and the following hypothesis holds: 

(HH4) There exist a constant rj > and a function q) e C^{A\ U) with (p{0) — 0, 
where v e {1, 2, . . .} and A — {x e di" : \x\ < 4ri}, such that 

>i^{x, (p(x)) < for all x e di" with \x\<2r] (6.162) 

then, the mapping k is time invariant. 

Proof of Theorem 6.2 Implications (a) =► (b) is obvious, and we prove implications 
(c) ^ (a) and (b) =► (c). 

(c) =► (a) Suppose that (1.3) admits an ORCLF. Without loss of generality, we 
may assume that the function q e £ involved in (6.159) is positive for all t >0. 

Furthermore, define 

Sit,x,u):^'I^(t,x,u)-Eq{t) (t, x, u) edi'^ x di" x U (6.163) 
S{t,x,u):^S(0,x,u) (t,x,u)e(-l,0)xdi" xU (6.164) 

The definition of E, given by (6.163), (6.164), guarantees that the function S : 
(-1, +oo) x dt" X [/ ^ iU U {+00} with E(t, 0, 0) = -8^(max{0, t}) for all t > 
— 1 is such that, for each u e U, the mapping (t,x) -^ S{t,x, u) is upper semi- 
continuous. By virtue of (6.159) and the upper semi-continuity of E , it follows that 



6.6 Lyapunov Functionals: The Control Lyapunov Functional 295 

for each (f, x) e (—1, +oo) x di", there exist u — uit, x) e U and S — S{t, x) e 
(0, f + 1) such that 

S[r,y,u(t,x)) <0 

W(r,y)e{{r,y)e(-l,+oo) xdi" -.Ir - t\ + \y - x\ < 8} (6.165) 

Using (6.165) and standard partition of unity arguments, we can determine se- 
quences {(ti,xi) e (-l,+oo) X !H"}~p {«,- e U}°Z^, and {5,}~j with 3; = 
^(f,-,x/) e (0, f/ + 1) associated with a sequence of open sets {^i}°Zi ^i^^ 

^i c {(r, y) e (-1, +(») X Sir : |r - r,| + |y - x/| < ^/} (6.166) 

forming a locally finite open covering of (— 1 , +oo) x i)i" such that 

Sir,y,ui)<0 W(r,y)eQi (6.167) 

Also, a family of smooth functions {0/}^j with 6i(t,x) > for all (f,x) e 
(— 1 , +oo) X iH" can be determined with 

supp0,cfi; (6.168) 

oo 

^0/(f,x) = l V(f,x)e(-l,+oo) xDt" (6.169) 

(=1 

The facts that .^(f , 0, 0) = -8g(f) < for all f > and that the mapping (t,x) ->■ 
E(t, X, 0) is upper semi-continuous imply that for every f > 0, there exists S(t) > 
such that S{r, y,0)<0 for all (r, y) e S)t+ x !H" with |r - f | + lyl < S{t). Utihzing 
the compactness of [0, T] for every T > 0, we conclude that for every T >0, there 
exists 5(7) > such that 

(t, y) e [0, r] X SR" and \y\<S(T) =^ S{r,y,0)<0 (6.170) 

Define the following function: 

W)-^\{[t] + l-tys{[t] + l) + ^{t-[t])S{[t] + 2) t>0 (6.171) 

where [t] denotes the integer part of f > 0. Notice that by definition (6.171) it fol- 
lows that fiik) = ^S{k + 1), limf^(j._,_i)- ri{t) = ^S(k + 2) for all k e Z+, which 
implies that rj is continuous. Moreover, definition (6.171) gives 

0<i7(f)< -max{S{[t] + l);8{[t] + 2)} for all f > 0, 

which, in conjunction with (6.170) and the inequality f < [f ] + 1 < [?] + 2, implies 

\x\<2ii{t) ^ E{t,x,O)<0 (6.172) 

Let fj : fR'^ — ^ (0, -l-oo) be the positive, continuous, and nonincreasing function de- 
fined by ri(t) :— mino<r<r '?(t). Let (p e C°°(di; [0, 1]) be a smooth function with 
/q <p(s)ds > 0, (p{s) — for all i' < and i' > 1. Define rjit) :— Jq (p(s)ri{t + s)ds, 
which is a C°° positive function that satisfies ri(t) < r](t) for all f > 0. Consequently, 
by virtue of (6.172), we obtain 

\x\<2ri{t) ^ S(f,x,0)<0 (6.173) 
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Let h e C°°(S)i; [0, 1]) be a smooth nondecreasing function with h{s) — for all 
s <0 and h(s) — 1 for all .? > 1. Define 

kit,x):^h r '^ 2 jE^'^^'^)"' (6.174) 

Clearly, k as defined by (6.174) is a smooth function with k(t, 0) = for all f > 0. 
Moreover, since k(t, x) is defined as a (finite) convex combination of m, e U and 
e C/, we have k{t, x)eU for all (r, x) e S)i+ x 3r. 

Let (f,x) e Dt+ x M" with |jc| > 2r]{t) and define a finite set J{t,x) — {j e 
{1,2,.. .}; 0jit, x) / 0}. By virtue of (6.160) and definition (6.174), we get 

sup V°(f,x; f(t,d,x,k(t,x))) 
deD 

— supV'^{t,x; fit,d,x, y2 0iit,x)uj\\ 

<-p{V(t,x))+ max {il'{t,x,uj)} (6.175) 

JeJ(t,x) 

Notice that for each j e J(t,x), we obtain from (6.168) that {t,x) e Qj. Conse- 
quently, by virtue of (6.167) and definition (6.163), we have that ^(t,x,u j) < 8^(?) 
for all j e Jit, x). Combining the previous inequality with inequality (6.175), we 
conclude that the following property holds for all {t,x,d) e !){"*" x di" x D with 
\x\>2r](ty. 

V°{t, x; f{t, d, X, k(t, x))) < -p{Vit, x)) + Sqit) (6.176) 

Let (t, x) e !K+ X *)i" with |x| < V2r](t). Notice that by definition (6.174) we get 

sup y°(f , x; f(t, d, X, k{t, x))) — sup V°{t, x; /(f , d, x, 0)) 
deD deD 

By virtue of (6.173), (6.163), and the above inequality, we conclude that (6.176) 
holds as well for all (t,x) e 9{"'" x di" with |x| < y/2ri(t). Finally, for the case 
(f , x) e di+ X di" with V2?7(0 < |x| < 2r](t), let J(t, x) = {; e {1, 2, . . .}; 6»/(f , x) / 
0} and notice that from (6.160) we get 



sup y°(f , x; f[t, d, X, k(t, x))) 



deD 



■■ supV^(t,x;f(t,d,x,h(— , '' 

del \ '{ \ V(0 ^^^^^^^_^^ 






< -p(y (f , x)) + max{t^(f , X, 0), i//(r, x, uj), j e J{t, x)} (6.177) 

Taking into account definition (6.163) and inequalities (6.167), (6.168), (6.173), 
and (6.177), we conclude that (6.176) holds as well for all (f, x) e di+ x S){" with 
V2riit) < |x| < 277(f). Consequently, (6.176) holds for all (f, x) e m+ x di" . 

It follows from (6.176) and Theorem 2.4 in Chap. 2 that system (1.3) with u — 
/t(f,x)isRGAOS. 
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(b) =► (c) Since system (1.3) with u — k(t,x) is RGAOS and since f{t,d,x, 
k(t, x)) is Lipsciiitz with respect to x on each bounded subset of SW"'" x S1{" x D, it 
follows from Theorem 2.1 in Chap. 2 and Theorem 3.5 in Chap. 3 that there exists a 
function V e C*'(S){"'" x S){"; SH"*") being locally Lipschitz and functions ai,a2 e Koo 
and j6, /x e K~^ such that 

ai{\{fi(t)x,Hit,x))\)<V{t,x)<a2{P{t)\x\) W(t,x) e9i+ x di" (6.178) 

supV°{t,x; f{t,d,x,k(t,x)))<-Vit,x) V(r,x)eS){+ X i)i" (6.179) 

deD 

We next prove that V is an ORCLF for (1.3). Obviously, property (i) of Defini- 
tion 6.2 is a consequence of inequality (6.178). Define, for all {t, x) e di~^ x di'\ 

^{t,x,u) :— Lv{t + \x\)Lu{t + \x\ + 2|A:(f,x)| + |m - ^(r, jc)|)|m -k(t,x)\ 

(6.180) 

where Ljj : Dt"*" -^ di~^ and Ly '■ i)i''~ -^ di'^ are continuous nondecreasing functions 
satisfying 

\fit,d,x,u)-f(t,d,x,v)\<Lu{t + \x\ + \u\ + \v\)\u-v\ 

V(f, X, d, u, v) e di+ xdr X DxU xU (6.181) 

and 

\Vit,y)-Vit,x)\<Lv{t+\x\ + \y\)\y-x\ V(r, x) e 3t+ x SH" (6.182) 

Inequality (6.159) with ^(f) = is an immediate consequence of definition (6.180). 
Clearly, definition (6.180) implies i//(r, 0, 0) = for all t > 0. 

Notice that for every (t,x) e Dt"*" xdi" and all finite sets {ui,U2, ■ ■ ■ ,Up} C U and 
A,,- e [0, 1] (/ = 1, . . . , p) with ^f_j A/ = 1, definition (6.180), in conjunction with 
the fact I ^f_j A/M( — k{t, x)\ < ^f_j A/Im,- — k(t, x)\ < max,=i,..._p |m; — k(t, x)\, 
implies that 

ti'lt,x,y^XiUi]< max ^{t,x,Ui) (6.183) 

By definition (2.128) in Chap. 2 and inequality (6.182) we get, for all {t, x, v, w) e 
9t+ xi1{" xm" xm", 

V°(t,x; V) <Lv{t + \x\)\v -w\ + V°{t,x; w) 

Combining the above inequality with inequalities (6.179), (6.181) and defini- 
tion (6.180), we obtain, for all (r, x, u) e S1{+ x di" x U, 

sup y°(f,x; f{t,d,x,u)) 
deD 

< sup V°{t, x; f[t, d, X, k(t, x))) 

deD 

+ Ly(t + |x|) sup |/(r, d, X, u) — f(t, d, X, k(t, x)) | 
deD 

<-Vit,x) + Lv{t+\x\)Lu(t+\x\ + \u -k(t,x)\ +2|^(f,x)|)|M - kit,x)\ 

< -Vit,x) + ^{t,x,u) 
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The above inequality, in conjunction with (6.183), implies that inequality (6.160) 
with p(s) :— s holds. 

The proof is complete. D 

Proof of Theorem 6.3 Suppose that (1.3) admits an ORCLF which satisfies (6.159) 
with g(0 = 0. Define 

S(f,x,M):=t^(f,x,M)- -p(y(r,x)) (f,jc,M)eM+ xM" X [/ (6.184) 

S(t,x,u):^SiO,x,u) (f,jc,M)e(-l,0) xSli" X [/ (6.185) 

The definition of S, given by (6.184) and (6.185), guarantees that the function 
E : (-1, +oo) X M" xU -^mu {+00} with S{t, 0, 0) = for all r > -1 is such 
that, for each u e U, the mapping (t,x) -^ 3{t,x,u) is upper semi-continuous. 
By virtue of (6.159) with q(t) = and the upper semi-continuity of E , it fol- 
lows that for each (t, x) e (—1, +00) x (M"\{0}), there exist u — u(t, x) e U and 
S — S{t,x) e (0, min(l,r + 1)) such that 

E{r, y, u{t, x)) < 
V(t, y) e {(r, y) e (-1, +00) x m" : \r - t\ + \y - x\ < 8} (6.186) 

Using (6.186) and standard partition of unity arguments, we can determine se- 
quences {(ti,xi) e (-1, +00) X (J)r\{0})}~i, {m/ e U}fZv and {^/}~i with St = 
S{ti,Xi) e (0, min(l, f/ -|- 1)), associated with a sequence of open sets {^/}^i with 

A c {(r, y) e (-1, +00) X sr : |r - f,| + |y - x,l < Si} (6.187) 

forming a locally finite open covering of (—1, +00) x (M"\{0}) and such that 

E{r,y,Ui)<0 W(r,y)e^i (6.188) 

Also, a family of smooth functions {0,}^j with 9i(t,x) > for all (t,x) e 
(—1, -|-oo) X (Ot"\{0}) can be determined with 

supp0,C^,- (6.189) 

00 
^0,(f,x) = l V(r,A:)e(-l,+oo)x (a{"\{0}) (6.190) 



We define 



^?,jc):=^0;(f,jc)M,- forr>0, x/0 (6.191) 

k(t, 0):^0 forf>0 (6.192) 

/:(r,x) := (1 -/z(^^=^|^))^(r,Pre(o(x)) 
/\x\^-2ri^(t)\~ 
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where r] e K'^ and q) e C"{A; U) are the functions involved in hypothesis (HH3), 
h e C°°(9i; [0, 1]) is a smooth nondecreasing function with h(s) — for all i < 
and h{s) = 1 for all s>l, and Q(t) ^ {x e S){" : |jc| < 377(f)}. Clearly, k as defined 
by (6.193) is of class C''{m+ x !1f' ; U) with k(t, 0) = for all t > 0. 
Next, we show that 

V°{t,x; f{t,d,x,k(t,x)))< — p{V{t,x)) V(r,x,rf)e9{+ x S){" x D (6.194) 

Let (f, x) e di+ X ;)i" with |jc| < V2ri(t). Notice that by definition (6.193) we get 

sup y°(r, x; f[t, d, x, k(t, x))) — sup V^[t, x; f[t, d, x, (p(t, x))) 
deD deD 

The above inequality, in conjunction with inequalities (6.160), (6.161), implies that 
inequality (6.194) holds for all (f,x) e i1{+ x !1{" with \x\ < y/2rj{t). For (t,x) e 
m+ X (9i"\{0}) with |x| > 2/7(0, define J{t, x) = {; e {1, 2, . . .}; Ojit, x) / 0} (a fi- 
nite set). Notice that by virtue of (6.160) and definitions (6.191), (6.193), we get 

sup V^{t,x; f[t,d,x,k{t,x))) 



deD 



i^V^it,x\ fit,d,x, V 



sup y I f,x; /I /',ii, x, > 6j{t,x)uj 
deD \ \ ,.^ ,,. ^.j 



<-p{V(t,x))+ max {^{t,x,Uj)] (6.195) 

jeJ(t,x) 

Notice that for each / e J{t,x), we obtain from (6.189) that (t,x) e f2j. Con- 
sequently, by virtue of (6.188) and definition (6.184), we have that 'I^(t, x, uj) < 
^p(V(t,x)), for all j e J(t,x). Combining the previous inequality with inequal- 
ity (6.195), we conclude that (6.194) holds. 

In a similar way, we can show that inequality (6.194) holds for all (r, x) e di~^ x 
di" with V2??(f)< |x| <2?7(f). 

If the ORCLF V and the function ^ involved in property (ii) of Definition 6.2 are 
time-independent, then the partition of unity arguments used above may be repeated 
on 9l"\{0} instead of !){+ x (!){"\{0}). If in addition hypothesis (HH4) holds, then 
the constructed feedback is time invariant. 

The fact that system (1.3) with u — k(t,x) is URGAOS follows directly from 
Theorem 2.4 in Chap. 2 and inequality (6.194). The proof is complete. D 



6.6.3 Control Systems Described by ODEs: Remarks and Feedback 
Design 

The problem with Definition 6.2 of the ORCLF that might arise in practice is the as- 
sumption of the knowledge of the function ^ : d\~^ x di" xU —>■ MU {+00} involved 
in property (ii) of Definition 6.2. Particularly, the following problem arises: 
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Problem (P) Consider system (1.3) under hypotheses (Hl-4) and (HH2). Is the 
function V : !){"*" x !){" — >• S)?"*" involved in the following hypothesis an ORCLF for 
system (1.3)? 

(HH5) The function V : DJ"*" x !){" -^ ?i\'^ is a C^ function which satisfies prop- 
erty (i) of Definition 6.1, and there exist a function q e £ and a C" positive definite 
function p : Sit"*" —y Sit"*" such that the following inequality holds: 

\dV fdV 

inf — (f,x)+supl — (t,x)f(t,d,x,u) 
ueU [ dt deD\ 9-*^ 

<-p{V(t,x))+qit) Wit,x)em+ xm" (6.196) 

The proof of implication (b) =► (c) of Theorem 6.2 gives insights for the solution to 
Problem (P): If there exist a continuous function k : Sit"*" x S1{" ^ t/ with A:(r, 0) = 
for all f > 0, a function q e £, and a C° positive definite function p : J)!"*" -^ ;)i"'"such 
that 



-{t,x)+ sup( — it,x)f(t,d,x,k{t,x)) I 
deD\'<^x ■ ' ) 



<-p{V(t,x))+qit) W{t,x)em+ xm" (6.197) 

then, V is an ORCLF for (1.3). Particularly, the function tf/ : 9t+ x J)t" x U ^ 
di U {+00} involved in property (ii) of Definition 6.2 may be defined by 

^{t,x,u) 



p(y(f, 


-)) 


+ sup 


fay dv 

(t,x)+—(t,x)f(t,d,x,v): 
dt dx 



d e D,v e C/with|ii - ^(f,x)| < \u - k(t,x)\ \ (6.198) 

It is easy to check that I' : di+ x di" x U -^ m U {+00} as defined by (6.198) 
satisfies inequalities (6.159), (6.160) of Definition 6.2, following exactly the same 
procedure as in the proof of implication (b) =► (c) of Theorem 6.2. Moreover, by 
virtue of Theorem 6.2, if V : M+ x M" -^ 9J+ is an ORCLF for system (1.3), then the 
proof of implication (c) =► (a) of Theorem 6.2 shows that there exist a continuous 
function ^ : 9i+ x M" ^ [/ with k(t, 0) = for all ? > 0, a function q e £, and a 
C*' positive definite function p : Di"*" -^ M+such that (6.197) holds. Consequently, 
V:di+ X m" -^ m+ is an ORCLF for (1.3) under hypotheses (Hl-4) if and only if 
there exist a continuous function k : di~^ x S){" -^ U with k(t, 0) = for all t >0, 
a function q e £, and a C'^ positive definite function p : di'^ -^ SH+such that (6.197) 
holds. 

The problem with the above solution to Problem (P) is that we can check if 
V : dl'^ X iU" —y f)}"*" is an ORCLF for (1.3) by constructing a feedback stabilizer 
for (1.3). On the other hand, our goal in practice is to construct a desired feedback 
stabilizer based on the mere knowledge of the Lyapunov function V : di~^ x !H" -^ 
Di"*" under hypotheses (Hl-4), (HH2), and (HH5). Consequently, the above solution 
to Problem (P) cannot be helpful for feedback construction purposes. 
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The rest of this paragraph provides sufficient conditions for estabhshing that 
y : 9t+ X m" -^ ;)i+ under hypotheses (Hl^), (HH2), and (HH5) is an ORCLF 
for (1.3). 

Indeed, if the mapping u ^- |^(?, x)f(t, d, x, u) is quasi-convex for each fixed 
{t,x,d) e S){+ X *){" X D, then the mapping u -^ ^(t,x) + sup^g£,(|j(r,x) x 
f(t,d,x,u)) is quasi-convex for each fixed (t,x) e di~^ x SH". Thus, property 
(ii) of Definition 6.2 is satisfied with ip{t,x,u) :— piV(t,x)) + ^(t,x) + 
swp^^Di^(t,x)f(t,d,x,u)). This is exactly the case arising in affine-in-control 
systems: for affine-in-control systems, the mapping u -^ ^(t,x)f(t,d,x,u) is 
convex. 

Example 6.6.1 For an autonomous affine-in-control system 

X — fid, x) + g(d, x)u 

xem",uem,deD (6.199) 

where f,g:Dx di" —^ S){" are locally Lipschitz mappings with f(d,0) — Q for all 
d e D, D C'Si' is a compact set, a SRCLF is a locally Lipschitz, positive definite 
function V : Sit" —>■ di~^, with {x e di" : V(x) < a] being a compact set for every 
a > 0, which satisfies 

V°{x; fix) + gix)u)<a(x) + b(x)u V(jc, m) e M" x ?){ (6.200) 

for certain locally Lipschitz mappings a,b :di" ^ di with a (0) — b{0) — and such 
that 

b{x)^0 and x^O => a(x)<0 (6.201) 

aix) + bix)(pix) < forallxe A\{0} (6.202) 

where (p e C^(A; i)i) is a locally Lipschitz function with ^(0) = 0, A = {jc e d\" : 
\x\ < 4ri}, and ?; > is a constant. 

A locally Lipschitz version of the feedback law proposed by Sontag [53] is de- 
fined, for X ^ 0, by 



k(x) := 



ifb(x)^0 



(6.203) 



k(x) := (l -h O''^ 2^^ \](p{PrQ(x)) + hO^^^-^Vkix) (6.204) 

where h e C°(iW; [0, 1]) is a locally Lipschitz, nondecreasing function with h{s) — 
for all i < and h{s) — I for all .? > 1, and Q = {x e Sit" : |x | < 3)7}. 

Using the arguments in [62], it can be shown that the mapping k : SH" -^ di as 
defined by (6.203), (6.204) is a locally Lipschitz mapping. In fact, if the functions 
a,b:m" ^m, he C°(S1{; [0, 1]), and cp e C°(A; SH) are of class C\ where v e 
(1,2, . . .}, then k : m" ^ Sit as defined by (6.203), (6.204) is also a mapping of 
class C". 
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Inequality (6.200) shows that V°{x; f(x) + g{x)k{x)) < -P{x) for all x e !H", 
where 

P(x):^p{x) forall |;c| >2?7 
Pix):^a(x) + bix)(pix) for all |x| < V2?? 

P(x):^(l-h O''^ ^^"^ \\{a(x) + b(xMx))+h O''^ '^"^ Vw 

for all V2ri < \x\ <2ri 

where 

\a(x) ifbix) = 

^^ '~ \-./a^(x) + b'^(x) ifb(x)^0 

By virtue of (6.202), P : di" -^ di~^ is continuous and positive definite. It follows 
from Proposition 2.2 in Chap. 2 that V : dl" ^ Sft+ is a SRCLF for (6.199), which 
satisfies property (ii) of Definition 6.2 with ^(x, u) := P(x) + a(x) + b(x)u. 

The following lemma helps us to give sufficient conditions for a function satis- 
fying hypothesis (HH5) to be an ORCLF. 

Lemma 6.4 For a mapping / : A x t/ — >• i){, where U c ^ff" is a closed convex set, 
define the set-valued map 

A X U 3 (x,u) ^U{x,u) ■.^cd{v eU : f{x,v) < f(x,u)] (6.205) 

and the mapping tj/ : A x [/ — >• Sit U {+00} by 

if(x, u) :— sup{/(x, v) : v eU(x, m)} (6.206) 

Then for every finite set [ui, U2, ■ ■ ■ ,Up} C U and for every ki e [0, I] {i — I , . . . , p) 
with ^,_j A.; = 1, it holds that 

/jx,^A/M/ j <max{Vf(x,M,),/ = 1, ...,;?} Vx e A (6.207) 

Proof Consider a finite set {ui, U2, ■ ■ ■ , Up} C U and A/ e [0, 1] (/ = 1, . . . , p) with 
S^f=i ^i — 1- L^*- " ^ f**!' "2> ■ ■ • 1 Up] be such that /(x, u) — max,=i ^ /(x, m,). 
It follows from definition (6.205) that ^f_jA./M, eU(x,u), and consequently, 
by definition (6.206), we get /(x, ^f'_j 1/m,) < \[r{x,u). The previous inequal- 
ity combined with the fact that u e {ui,U2, ■ ■ ■ ,Up} (which implies \l/(x,u) < 
max{i/f (x, Ui), i — I, . . . , p}) establishes (6.207). The proof is complete. D 

The following lemma is a direct consequence of the previous lemma. 

Lemma 6.5 Let V : SH"*" x Sli" —y SH"*" be a C function which satisfies the following 
properties: 
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(i) there exist functions q E £ and p : di~^ — >• di~^ being C positive definite such 
that for all (t, x) e JW+ x !W", there exists u eU with U(t, x, u) C U{t, x) / 0, 
where 

— \ fdV 

U{t,x, u) :— CO V eU : supl — {t,x)f{t, d,x,v) 
deD\3x 

fdV 

< supl (t,x)f(t, d, X, u) 

deD\dx 

dV (dV 

V eU : — {t,x) + supl — {t,x)f(t, d,x,v) 
dt deD\9x 



U{t,x):^ 



<-p{V{t,x))+q(t)y 



(ii) for each fixed u e U , the mapping (?,x) — >• sup{sup^g£,(-g— (?,x)/(f,flf,x, i;)) : 
V e lA{t, X, u)} is upper semi-continuous. 



av , 



Then, property {\\) of Definition 6.2 holds with ^(f, x, u) :— p{V {t, x))+ -jr{t, x) + 



(dV 



sup{sup^g^(-g^(f,x)/(f,(jf,x, v)) : V eU{t,x, u)}. 



It should be noted that if the mapping u ^- 'l^it , x) f (t , d , x , u) is quasi-convex 
for each fixed {t,x,d) e iH"*" xdi" x D, then the set- valued map 



L({t, X, u) :— CO 



, dV 

V eU : supl — (f, x)f(t, d,x, v) 
deD\ 9-'^ 



< s\xp{^—{t,x)f{t,d,x,u)]\ 
deD\ox /J 



in (i) of Lemma 6.5 satisfies 
U{t, X, u) 



, dV \ (dV 

V eU : supl — {t,x)f{t,d,x, v) I < supl — (f, x)f(t,d,x,u) 
deD\dx ) deD\dx 

Consequently, property (i) of Lemma 6.5 becomes equivalent to the existence of 
u e C/with ^(t,x) + sup^^[)i^(t,x)fit,d,x,u))<-p(V(t,x)) + q(t). 

The following example illustrates the use of Lemma 6.5 for a special class of 
nonlinear systems. 



Example 6.6.2 Consider system (L3) under hypotheses (Hl-3) with m — l,U — ^, 
and a C^ function V : ilt"*" x M" -^ JH"*" which satisfies property (i) of Definition 2.6 
and 



dV 



dV 



-(t,x) + supl — (t,x)f(t,d,x,u) I —a{t,x)u+b{t,x)u + c{t,x) (6.208) 
9? deD\ ^x 



mi (a{t , x)u^ + bit , x)u + c{t,x)) < -plV(t,x)) +q(t) 



(6.209) 



for all {t,x, u) e di'^ x di" x U, appropriate continuous mappings a,b,c : SJ"*" x 
di" -^ d\ with ait, 0) = bit, 0) = c(f , 0) = for all f > 0, a function q e£, and 
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a C" positive definite function p : Dt"*" — >• Dt"*". We next prove that V : ?i\^ x !1{" -^ 
9J"'" is an ORCLF for (1.3), provided that the following implications hold: 

a(f,x)<0 ^ ^^ + c{t , x) < - piV {t , x)) + q(t) (6.210) 

Aa{t,x) 

For every sequence { (f, , x, ) } . _„ with a (ti , x,- ) < 

and (r,, X,) ^ (r, x) with a{t, x) = 0, it holds that — ^ (6.211) 

|a(r/,x/)| 

Following the notation of Lemma 6.5, define 

U{t, X, u) — cd[v e M : a{t, x)v^ + b(t, x)v < a(t, x)u^ + b(t, x)u] 
Vl(t,x)= {v edl:a(t,x)v^ + b(t,x)v + c(t,x) < -p{V(t,x)) +q(t)} 
Notice that 

1. If fl(f,x) > 0, then for every u e di, the set {ii e M : a(t,x)v^ + b(t,x)v < 
a(t, x)u^ + b(t, x)u] is closed and convex, and consequently, there exists u e 
di with U{t,x,u) C U{t,x) (specifically, by virtue of (6.209), the inclusion 
U{t, X, u) C U(t, x) holds for u = -|^). 

2. If a(r, x) — 0, then for every u e iW, the set {i; e !1{ : b{t,x)v < bit, x)u] is closed 
and convex, and consequently, there exists u e di with U(t,x,u) C.U(t,x). 
Specifically, if b(t,x) ^ 0, then the inclusion U{t,x,u) C U{t,x) holds for 
u = -'-^^"^^^y^"^ ■ If b(t, x) = 0, then by (6.209) the inclusion U(t, x, u) C 
U(t,x) holds for every m e Dt. 

3. Iffl(r,x) < 0, then, for every M / -^^, the set {d e ^il : a{t , x)v^ + b{t , x)v < 

a(t, x)u^ + b{t, x)u} is not convex, and there exist v\,V2& S1{ with v\ < vj such 
that 

{d e S)t : a(t, x)v^ + b(t, x)v < a{t, x)u^ + b{t, x)m} — (— oo, vy] U [V2, +oo) 

On the other hand, if m = - 2a{t% ^ ^^^"^ ^^ ^°^^^ ^^^^ ^'" ^ '^^ ■ «(^-«)'^" + 
b{t, x)v < a(t, x)u^ + b{t, x)u] — Dt. Consequently, if ait, x) < 0, then for ev- 
ery u e SH, it holds that U(t, x, u) — ?i\. However, in this case implication (6.210) 
guarantees that U(t,x) — 9i and therefore the inclusion U(t,x,u) C U{t,x) 
holds for every w e 9i. 

Thus, property (i) of Lemma 6.5 holds for the function V : Dt"*" x Dt" — >• Dt"*". 
Since ^{t,x,u) := p{V{t,x)) + '^{t,x) + sup{sup^;g£,(|^(f,x)/(r,rf,x, i;)) : 
V e U(t,x,u)], by virtue of all the above specifications for the set- valued map 
U{t,x, u), we get 

^(t,x,u) :=p(V(f,x)) 

f a{t, x)u^ + b{t, x)u + c(f , x) if a(f, x) > 



~ 4a(t,x) 



(6.212) 
c(f,x) if fl(f,x) < 
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Notice that implication (6.211) guarantees that property (ii) of Lemma 6.5 holds 
and consequently property (ii) of Definition 6.2 holds with ^ defined by (6.212). It 
should also noticed that other choices for the mapping ^(t, x, u) are possible. For 
example, the selection 

<I'(t,x,u) :=p(y(r,jc)) 

Ia(t,x)u^ + b(t,x)u + c(t,x) if a(t,x) >0 
(6.213) 
b(t,x)u + c(t,x) ifa(t,x)<0 

guarantees that V : M+ x di" -^ m+ is an ORCLF for (1.3), provided that (6.208), 
(6.209), and the following implication hold: 

ait,x)<0 bit,x)^Q ^ cit,x)<-p{Vit,x)) + q(t) (6.214) 

Notice that if (6.214) holds then property (ii) of Definition 6.2 holds with ^ de- 
fined by (6.213). Moreover, notice that if implication (6.210) holds, then implication 
(6.214) automatically holds. 

The following lemma provides a "patchy" construction by combining the formula 
provided by Lemma 6.5 and the knowledge of appropriate functions that can be used 
in certain regions of ffl'^ x Dt" as feedback functions. 

Lemma 6.6 Let V : fR~^ x ?){" -^ di~^ be a C function and suppose that there exist 
sets Qi c iH+ X W (/ = 0, . . . , p) with Qi n f2 j = 0/or / / j and [Ji=o....,p ^' = 
Ot"*" X di" , functions k, : Qi —>■ U (i — I, . . . , p), a function q E £, and a C positive 
definite function p : Sit"*" — >• Sit"*" such that 

1. for every (t, x) e ,f2o, there exists u e U with U(t, x, u) C tl{t, x) ^ 0, where 

— \ /9^ 

U{t, X, u) :— CO V eU : sup ( — (f, x)f(t, d, x, v) 

/dV 
< supl — {t,x)f{t,d,x,u) 
deD\ox 



f dV ( 

Uit,x) :— \v eU : — (f,x) + supl 
I ot deD\ 



dV 

-—(t,x)fit,d,x,v) 

ox 



<-p(V(t,x)) + qit) 

2. for all i — I, . . . , p and (t, x) e Qi, it holds that 
dV 



^ -(t,x) + 
dt a 



sup( (t,x)f(t,d,x,ki(t,x)) ) < -p(V(t,x)) + q(t) 
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Consider the function ^ : Di"*" x di" x U ^ diU {+00} defined by 

. dV 
1'(t,x,u) :=p(y(f,jc)) H (t,x) 



+ sup 
for (t,x) e Qo 



dt 
sup I — {t,x)f{t, d,x,v) 1 : V eU{t, x, u) 



,(■ 



(6.215) 



^{t,x,u) :=p(y(?,jc)) 
+ sup 



dV dV 

— {t,x)-\ {t,x)f(t,d,x,v):deD,veU 

dt dx 



with \v — ki(t, x)\ < \u — ki (t, x) I 

for(t,x)eQi,i^l,...,p (6.216) 

and suppose that <^ : Ot"*" x 9t" x [/ — >• !W U {+00} is upper semi-continuous. 

Then property (ii) of Definition 6.2 holds with ^ : Jit"*" x Ot" x [/ ^ i)i U {+00} 
defined by (6.215), {6-216). 

The following example illustrates the efficiency of Lemma 6.6. It shows that the 
knowledge of appropriate functions that can be used in certain regions of Di"*" x di" 
as feedback functions helps us to obtain less conservative results. 

Example 6.6.3 Consider system (1.3) under hypotheses (Hl-3) with m— 1,11 — ^1, 
and a C^ function V : iU+ x ilt" -^ Dt"*" which satisfies property (i) of Definition 6.1 
and (6.208), (6.209) for appropriate continuous mappings a,b,c : i)}"*" x !){" —^ S){ 
with fl(f , 0) — b(t, 0) — c(t, 0) = for all f > 0, a function q e8, and a C° positive 
definite function p : !]{"'" — >• Dt"*". We showed in Example 6.6.2 that V : Bt"*" x di" -^ 
m+ is an ORCLF for (1.3), provided that impHcations (6.210), (6.211) hold. In 
this example, we show that implication (6.211) only is sufficient for guarantee- 
ing that V :m+ xm" ^ di+ is an ORCLF for (1.3). Indeed, let Qo := {(t,x) e 
m+ X M" : ait, x) > 0} and ^1 := {(t, x) e iH+ x m" : a(t, x) < 0}. Moreover, de- 
fine ki : Qi ^ d\ as follows: V(r, x) e Qi, 



yjb'^it, x) + 4|fl(r, x)c{t, x)\ + 4|fl(r, x)\p{V(t, x)) - bit, x) 

ki (t, x) := -— (6.217) 

la{t, x) 

The specification of the set-valued map U(t, x, u) for (t, x) e Qq has been given in 
Example 6.6.2. Therefore, the function W : !){+ x m" xU ^mu {+00} defined by 

^(t, X, u) :— p{y{t, x)) + a{t, x)u^ + b{t, x)u + c{t, x) 

fox{t,x)eQo (6.218) 

^(t,x,u) :— p[V{t,x)) 

+ sup{fl(f,x)ii + b{t , x)v + c{t , x) : \v — ki{t , x)\ < |m — ^i(f,x)|} 

for (f , x) e Qi (6.219) 
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Clearly, '/'(?, x, u) as defined by (6.218) is continuous on the interior of Qq. Fur- 
thermore, it follows from the continuity of a{t , x) , b(t , x) , c{t , x) , k\(t , x) on Q\ 
and Theorem 1.4.16 in [7] that ^{t,x,u) as defined by (6.219) is upper semi- 
continuous on f2i. The reader should notice that implication (6.211) guarantees 
that 'P :dt~^ X M" X [/ ^^ S)t U {+00} is upper semi-continuous (since ^{t,x,u) < 

p{V(t, x)) - 'I^Ij'^I + c{t, x) for all (r, x, u) e Qi x 9t). Consequently, Lemma 6.6 
guarantees that property (ii) of Definition 6.2 holds with ^ : !]{"'" x !H" x U —^ 
m U {+00} as defined by (6.218), (6.219) and that y : S1t+ x 9J" -^ 9J+ is an ORCLF 
for (1.3). 



6.6.4 Control Systems Described by RFDEs 

In this paragraph we present the extension of the Artstein-Sontag methodology to 
infinite-dimensional systems described by Retarded Functional Differential Equa- 
tions (RFDEs). Particularly, we consider control systems of the form (1.10) under 
hypotheses (Sl-5) and the following additional hypothesis: 

(SS) The mapping u —^ f(t, d, x, u) is Lipschitz on bounded sets, in the sense that 
there exists a continuous, nondecreasing function Ljj : Sit"*" -^ d\~^ with the 
following property: 

\f(t,d,x, u) — f(t, d, X, v)\ < Lyit + \\x\\i- + \u\ + |i;|)|m — i;| 

V(f , X, d, u, v) e m+ X C°{[-r, 0]; S1{") xDxU xU (6.220) 

Moreover, the set D C S)i' is compact, and U C 9t"' is a closed convex set. 

We next give the definition of the Output Robust Control Lyapunov Functional 
for system (1.10). The definition is in the same spirit with Definition 6.2 of the 
notion of ORCLF for finite-dimensional control systems. 

Definition 6.3 We say that (1.10) under hypotheses (Sl-5) and (SS) admits an Out- 
put Robust Control Lyapunov Functional {ORCLF) if there exists an almost Lips- 
chitz on bounded sets functional V : Sit"'" x C^{[—r, 0]; S){") -^ M"*", referred to as 
ORCLF, which satisfies the following properties: 

(i) There exist functions a\,a2 e Koo and P, jJ. & K^ such that the following in- 
equality holds for all (f , x) e M"^ x C°([-r, 0]; ilf ): 

max{fli(||//(f,jt:)||-y),ai(/i(OI|.x||r)} < V{t,x) <a2{P{t)\\x\\r) (6.221) 

(ii) There exists a function 1// : S1{"^ x *){'' x [/ ^ Sit U {+00} with ^{t, 0, 0) = 
for all r > such that for each u e U, the mapping (t,(p) -^ W{t,q),u) 
is upper semi-continuous, a function q e £, a continuous mapping Sit"*" x 
C°([-r, 0]; S){") 3 it,x) -> 0{t,x) e Df' being completely locally Lipschitz 
with respect to x e C°([-r, 0]; SR") with 0(t, 0) = for all t > 0, and a C° 
positive definite function p : SW"*" -^ [({"""such that the following inequality holds: 

inf tl^(t,(p,u)<q{t) Vf >0, V^ = (^i,...,^„)'ei)i/' (6.222) 
ueU 
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Moreover, for every finite set {ui, uj, ■ ■ ■ , u^} C U and for all A, e [0, 1] (; — 
l,...,N) with J2^^[ ^; = 1> it holds that 



supy°( t,x; f[t,d,x 
deD \ \ 



P")) 



<-p(V(t,x)) max \<I'(t,0it,x),Ui)\ 

^ 1=1, ...,n'- ^ " 

W{t, X) e m+ X C°([-r, 0]; m") (6.223) 

For the case H(t, x)=xe C°([-r, 0]; m"), we call V : M+ x C°([-r, 0]; di") -^ 
Oi"*" a State Robust Control Lyapunov Functional (SRCLF). 

Remark 6.1 Clearly, in the finite-dimensional case, the continuous mapping 
0{t,x) — (<5i(r,x), . . . , 0p{t,x))' is replaced by the mapping <P{t,x) := x e JH" 
with p — n. The question of the construction of the mapping tf' : 9t"'" x 9i^ x 
t/ ^^ S)i U {+00} can be handled in exactly the same way as shown in the 
previous section, provided that we can find appropriate continuous mappings 
(p{t,x) = (0i(f,jc),...,<Pp(?,;c))', G : Df{+ X M'' x f/ ^ at with p(V(t,x)) + 
sup^g^ y°(f,x; /(f,(i,x,M)) < G(t,0(t,x),u) for all (t,x) e 9i+ x 
C°([-r, 0]; at") and inf„g{/ G(t, (p, u) < q{t) for all (f, ^) e a{+ x af. In this case 
all constructions of ^ : at"*" x at^ x U ^ diU {+00} given in the previous sec- 
tion may be repeated with the quantity ^(t, x) + sup^g£)(|^(f , x)f(t, d, x, u)) + 
p(V{t, x)) replaced by the quantity G(t, cp, u). 

We are now in a position to state and prove our main results for the infinite- 
dimensional case (1.10). 

Theorem 6.4 Consider system (1.10) under hypotheses (Sl-5) and (SS). The fol- 
lowing statements are equivalent: 

(a) There exists a continuous mapping k : at"*" x C ([— r, 0]; at") 3 {t,x) — >• 
k{t,x) e U being completely locally Lipschitz with respect to x & 
C ({—r, 0]; at") with k{t, 0) = for all t > such that the closed-loop sys- 
tem {\.\0) with u = k{t,Tr(t)x) is RGAOS. 

(b) System (1. 10) admits an ORCLF. 

Theorem 6.5 Consider system (1.10) under hypotheses (Sl-5) and (SS). The fol- 
lowing statements are equivalent: 

(a) System (1.10) admits an ORCLF which satisfies inequalities (6.221), (6.222) 
with P(t) = 1 and q (t) = 0. Moreover, there exist continuous mappings r] e K'^ 
and A 3 (t, cp) -^ K(t, cp) e U, where A — lJ,>o{t} x {(p e di'' : \(p\ < 4r](t)}, 
which is locally Lipschitz with respect to cp with K(t,0) — Q for all f > 0, such 
that 

<I'{t,0(t,x),K{t,0(t,x)))<O 
forall(t,x)edi+ xC°([-r,0];a{") with \0(t,x)\ <2r](t) (6.224) 
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where <? = (<?i, . . . , (Pp)' : di+ x C°([-r, 0]; di") -^ diP and i/^ : !){+ x ^P x 
[/ — > 9t U {+00} are the mappings involved in property (ii) of Definition 6.3. 
(b) There exists a continuous mapping k : d\~^ x C ([— r, 0]; i)J") 3 (t,x) -^ 
k(t,x) e U, completely locally Lipschitz with respect to x e C ([—r,0]; Dt") 
with k(t,0) — for all t > 0, such that the closed-loop system (1.10) with 
u = k{t, Tr(t)x) is URGAOS. 

Remark 6.2 From the proof of Theorem 6.5 it will become apparent that if state- 
ment (a) of Theorem 6.5 is strengthened so that the ORCLF V, the mappings 
= (01, ... , 0py : di+ X C°([-r, 0]; di") -^ diP, ^ involved in property (ii) of 
Definition 6.3, and the mapping K : A^ U are time independent, then the continu- 
ous mapping k, whose existence is guaranteed by statement (b) of Theorem 6.5, 
is time invariant. Moreover, the proof of Theorem 6.4 shows that the feedback 
in statement (a) of Theorem 6.4 is actually a C°° function of t and 0{t,x); the 
reader should notice the analogy with Theorem 6.2 (in the finite-dimensional case 
<P{t,x):—x and p — n). 

Proof of Theorem 6.4 (b) ^ (a) Suppose that (1.10) admits an ORCLF. Without 
loss of generality, we may assume that the function q e £ involved in (6.222) is 
positive for all r > 0. 
Furthermore, define 

S{t,(p,u):^^{t,(p,u)-'i,q(t) for (f , ^, m) e SW+ X Slf X [/ (6.225) 
3{t,(p,u):^E(id,q),u) for (r, ^, m) e (-1, 0) x Di'' x C/ (6.226) 

The definition of S, given by (6.225), (6.226), guarantees that the function E : 
(-1, +00) X W X t/ ^ M U {+00} with E{t, 0, 0) = -8g(max{0, f}) for all t > 
— 1 is such that, for each u e U, the mapping (t, cp) -^ E{t, qi, u) is upper semi- 
continuous. By virtue of (6.222) and the upper semi-continuity of S, it follows that 
for each (t, q)) e (—1, +00) x diP, there exist u — u(t, cp) e U and S — S(t, ip) e 
(0, r + 1) such that 

E{r,y,u(t,(p)) <0 
V(r, y) e {(t, y) e (-1, +00) x M'^ : |r - f | + |y - (p\ < S} (6.227) 

Using (6.227) and standard partition of unity arguments, we can determine se- 
quences {(ti,(pi) e (-l,+oo) X ;)i''}~i, {ui e t/}^i, and {^,}~i with 5; = 
8{ti, (pi) e (0, t, + 1) associated with a sequence of open sets {.^/},^i with 

A C {(r, y) e (-1, +00) X diP : |r - f,| + \y - (Pi\ < 5,} (6.228) 

forming a locally finite open covering of (—1, +00) x i)J'' and such that 

E(r,y,Ui)<0 V(r, y) e ^/ (6.229) 

Also, a family of smooth functions {6i}f°_i with 9i(t,qi) > for all {t,x) e 
(— 1 , -t-00) X ^iP can be determined with 
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supp0/C^,- (6.230) 

oo 

^6>,(r,</^) = l V(r,^)e(-l,+oo)x9t'' (6.231) 

i=i 
Using exactly the same methodology as in the proof of Theorem 6.2 and the facts 
that E{t, 0, 0) — -8q(t) < for all f > and that the mapping (f, (p) -> Sit, cp, 0) 
is upper semi-continuous, we may establish the existence of a C°° positive function 
r] : Sit"*" —>■ (0, +oo) with the following property: 

\(p\<2r](t) ^ S{t,(p,0)<0 (6.232) 

Let h e C°°(di; [0, 1]) be a smooth nondecreasing function with h(s) — for all 
s < and h(s) = 1 for all ^ > 1. We define, for all (t, x) e 3{+ x C^([-r, 0]; di"), 

/|0(r,x)|2-2n2(f)\ ~ , 
k{t,x):^h r ^ 2(^) jJ2^i{t,^it,^))ui (6.233) 

where ^(0i,..., 0p)' : 9t+ x C^([-r, 0]; M") -^ diP is the mapping involved 
in property (ii) of Definition 6.3. Clearly, k as defined by (6.233) is a mapping 
satisfying the property that for every bounded i2 C iH"*" x C°([— r, 0]; 9i"), it holds 
that 

\k(t,x)-k(t,y)\ 1 

--.(t, x)ef2, {t, y)ef2, x^y] <+oo 



sup 

I ll-^-yll 

with ^(?,0) — for all f > 0. Moreover, since k(t,x) is defined as a (finite) 
convex combination of m, e t/ and e t/, we have k(t,x) e U for all (?,x) e 
9i+ X C^{[-r,0];m"). 

Let (r,x) e 9t+ x C*'([-r,0]; M") with |<?(f,x)| > 2r]{t) and define the finite 
set Jit,x) = {;• e {1,2, . . .}; 6»,(f, 0(r, x)) / 0}. By virtue of (6.223) and defini- 
tion (6.233), we get 

sup y°(f , x; f[t, d, X, k(t, x))) 

= sup y°(f,x; /(f,(i,x, V] 0y(f, 0(f,x))My ) ) 
''^^ ^ ^ JeJU,.) ' ^^ 

<-p{V(t,x))+ max {'P{t,0(t,x),uj)} (6.234) 

jeJ{t,x) 

Notice that for each j e J(t,x), we obtain from (6.230) that (t,0(t,x)) e 
Qj. Consequently, by virtue of (6.229) and definition (6.225), we have that 
^{t,0{t,x),Uj) < Sq(t) for all j e J{t,x). Combining the previous inequal- 
ity with inequality (6.234), we conclude that the following property holds for all 
(f,x,rf)eM+ X C''([-r,0];S){«) x £) with |<f (f,x)| >2r]{t): 

y°(f , x; /(f , d, X, k(t, x))) < -p{V{t, x)) + 8^(f) (6.235) 

Let (f,x) e *){+ X C°([-r, 0]; 9t") with \0{t,x)\ < V2r](t). Notice that by defini- 
tion (6.233) we get 

sup y°(f , x; f(t, d, X, fe(r, x))) — sup y°(f , x; /(f , (i, x, 0)) 
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By virtue of (6.223), (6.232), (6.225) and the above inequality, we conclude that 
(6.235) holds as well for all (t, x)em+x C°([-r, 0]; M") with \0(t,x)\< V2ri(t). 
Finally, for the case (f,jc) e Ot+ x C°([-r, 0]; !H") with V2r](t) < \0(t,x)\ < 
2r](t), let J(t, x) = {;• e {1, 2, . . .}; Ojit, 0(t, x)) / 0} and notice that from (6.223) 
we obtain 

sup y°(f , x; f[t, d, X, k{t, x))) 
deD 



— sup y"! t,x; /( t,d,x,h 



x\'-2n\t) 



InHt) , 



) E ^./(^^)«./)) 



deD 

<-p{V{t,x))+max{<I'{t,0{t,x),Q),^{t,cP{t,x),Uj),jeJ{t,x)] (6.236) 

Taking into account definition (6.225) and (6.229), (6.230), (6.232), and (6.236), 
we may conclude that (6.235) holds as well for all (t, x) e m+ x C°([-r, 0]; DT) 
with V2r]it) < \0(t, x)\ < 2ri(t). Consequently, (6.235) holds for all (t, x) e 9f{+ x 
C°([-r,0];9i"). 

It follows from (6.235) and Theorem 2.5 in Chap. 2 that system (1.10) with u — 
k{t,Tr{t)x) isRGAOS. 

(a) ^ (b) Since system (1.10) with u — k(t, Tr{t)x) is RGAOS, and since for 
every bounded ^ C Ot+ x C°{{-r, 0]; W), we have 



sup 



\k{t , x) - kit , y)\ 

' -^-^^ ■.{t,x)eQ,{t,y)eQ,xi^y\ < +00, 

Ik -y\\r 



it follows that the closed-loop system (1.10) with u — k(t, Tr(t)x) satisfies hypothe- 
ses (Sl-5). Moreover, since system (1.10) with u — k{t, Tr{t)x) is RGAOS, it fol- 
lows from Theorem 2.1 in Chap. 2 that there exists /Lt e A""*" such that the system 

i{t)^f{t,d{t),Tr(t)x,k{t,Tr{t)x)) 

y(r)= \H{t,x)\y + iJL{t)\\x\\r 
xit)em",Yit)em,d(t)eD (6.237) 

satisfies hypotheses (Sl-5) and is RGAOS. Notice that system (6.237) is the 
closed-loop system (1.10) with u — k(t,Tf(t)x) and output defined by Y(t) — 
\\H(t,x)\\y + fi(t)\\x\\r. It follows from Theorem 3.6 in Chap. 3 that there exist 
functions ai, 02 e Kqc and /J e A'+ and a mapping V : Di"*" x C°([— r, 0]; dl") —^ 
di~^, which is almost Lipschitz on bounded sets, such that, for all (t,x,d) e D't"'" x 
C°([-r,0];i1t") X D, 

ai (II H(t, x)\\y + fi{t) \\x II,) < V{t, x) < a2{P(t)\\x\\r) (6.238) 

V°{t, x; f{t, d, X, k(t, X))) < -Vit, x) (6.239) 

We next prove that V is an ORCLF for (1.10). Obviously property (i) of Defini- 
tion 6.3 is a consequence of inequality (6.238). Define, for all (t , (p) — (t , (p\ , ^2)' e 

m+ xMxjir, 
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:=Lv(r + |<?)i|)Lc;(r + |^i|+2|,p2l + |M-Prf;(^2)|)|M-Prf;(</)2)| (6.240) 
and, for all (t, x) e M+ x C°([-r, 0]; SH"), 

jm + l 



0(t,x):-- 



\\X\\r 

k(t,x) 



edf 



(6.241) 



where Lu : !1{+ —^ Sit"*" is the nondecreasing continuous function involved in (6.220), 
and Ly '■ M"*" -^ di~^ is a continuous, nondecreasing function that satisfies 

\V(t,y)- V(t,x)\ <Lv{t+ \\y\\r + \\x\\r)\\y-x\\r 

for all (t, x) e m+ x C°([-r, 0]; *){"). The reader should notice that (f , 0) = for 
all f > and that for every bounded Q C 9i+ x C°([-r, 0]; 9i"), it holds that 

\0(t,x)-0(t,y)\ 
sup 



: (t,x) e Q,{t,y) e Q,xy^ y\ < +oo 



The convexity of the set U c SH™ implies that the mapping dV" 3 (p2 ^ Pry (^2) 
is continuous and consequently that the mapping iW"*" x S)}"'"*"' 3 {t,(pi,(p2) —^ 
^{t,<pi,(p2,u) is continuous for each fixed u e U. Notice that for every qi = 
(t, (p\,V2)' e 9it+ X 9{ X ;){"' and every finite set {u\,u2, . . . , u^} c U, Xf e [0, 1] 
(i — I , . . . , N) with ^,_j A, = 1, definition (6.240), in conjunction with the in- 
equalities 



N 



'^XiUi -Pru(<P2) 



implies that 



y^ Xi \ui - Pry ((p2) I < max I m,- - Pry ((^2) I 

i = l 



W\t,(pi,(p2 



N \ 

/=1 / 



max <I'(t,(pi,(p2,Ui) 

= l....,N 



(6.242) 



By virtue of the definition of the Dini derivative V'^(t,x; v) and the properties of the 
Lyapunov functional, we get, for all (f , x, v, w) e M+ x C°i[-r, 0]; Sit") x S1{" x S1{", 

y°(f,x;i;)<Lv(f + ||jc||,.)|i; - wl + y°(f, x; w) (6.243) 

Combining inequalities (6.220), (6.239), and (6.243), we obtain, for all (t, x, u) e 
m+ xC*'([-r,0];i)J") x U, 

sup V [t, x; f{t, d, X, m)) 
deD 

< sup y°(f , x; f(t, d, X, k{t, x))) 



deD 



Lv{t- 



r) sup |/(r, d, X, m) — /(?, li, X, ^(f, x)) I 



(/eD 



<-V(t,x) + Lv{t+ \\x\\r)Lu{t+ ||x| 
< -y(f,x) + Li/(f + \\x\\r)Lu{t+ ||x| 
-|-2|A:(f,x)|)|M-jt(r,x)| 



|m| + |fc(r,x)|)|M -k(t,x)\ 
\u — k(t, x) 
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The above inequality, in conjunction with (6.242) and definitions (6.240), (6.241), 
implies that inequality (6.223) with p(s) :— s holds. Moreover, by definition (6.240), 
for every (t, ipi, ^2) £ '^^^ x 9t x di"\ there exists u e U (namely u — Pry ((^2)) such 
that (6.222) holds with q(t) = 0. The proof is complete. D 

Proof of Theorem 6.5 (a) => (b) Suppose that (1.10) admits an ORCLF which satis- 
fies (6.222) with q(t) = 0. Without loss of generality we may assume that the map- 
ping <? = (01, . . . , 0py : S)t+ X C'^il-r, 0]; *){«) -^ mP involved in property (ii) of 
Definition 6.3 satisfies 0i (t, x) :— V(t, x). Define 

E(t,(p,u):^^it,(p,u)- -p{c'(p) {t,(p,u)em+ xmP xU (6.244) 

E(t,(p,u):^E{0,ip,u) (t,(p,u)ei-l,0)xmP xU (6.245) 

c^ (l,0,...,Oy e^P (6.246) 

The definition of E , given by (6.244)-(6.246), guarantees that the function E : 
(-1, +00) X ^P X U ^mu {+00} with E(t, 0, 0) = for all f > -1 is such 
that, for each u e U, the mapping (t, ip) —!^ E(t, ip, u) is upper semi-continuous. Let 
@ :— (—1, +cxd) X {(p e d^P : c'cp ^ 0}, which is an open set. By virtue of (6.222) 
withq'(r) = and the upper semi-continuity of S, it follows that for each {t,q)) e 0, 
there exist M — u{t,cp) e U M/i\hS — 8{t,cp) e (0, min(l, f+l)),(5(r, i^) < ^,such 
that 

E{r,y,u(t,cp))<0 V(r,y) e {(r,y) e :\r - t\ + \y - <p\ < S} (6.247) 

Using (6.247) and standard partition of unity arguments, we can determine se- 
quences {(ti,<pi) e 0}°Zv {«/ e C/}~j, and {5,}~i with 3,- = S{t,,<pi) e 
(0, min(l, ti + 1)), Si — S(ti, (pi) < ^^-y^, associated with a sequence of open sets 
{X2/}~i with 

A c {(r,y) e : |r - f,| + \y - <^,| < Si} (6.248) 

forming a locally finite open covering of and such that 

Eir,y,Ui)<0 V(r, y) e f2; (6.249) 

Also, a family of smooth functions {^il^j with 0, (t, (f) >0 for all (t, (p) e can 
be determined with 

supp0/Cf2,- (6.250) 

00 
J2^'(t'<P)^^ '^(t,(p)e0 (6.251) 

We define, for all (t, x) e di+ x C^i[-r, 0]; Dt"), 

/ /|0(f,x)|2-2n2(f)\\ 

k(t,x):^i^l-h( ^ V(,) "' ))K{t,PrQO){0(t,x))) 

+ \ ^;^) j^(^'-^) ^6.252) 
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where 

oo 

^f,x):=^0/(r,0(f,jc))M; forr>0,x/0 (6.253) 

(=1 

k(t, 0) := for r > (6.254) 

where h e C°°(SM; [0, 1]) is a smooth nondecreasing function with his) — for all 
i < and h{s) — 1 for all ^ > 1, and Q{t) — {(pe S1F : \(p\ < 3ri(t)}. It follows from 
definition (6.252), (6.253), (6.254) and the facts that the continuous mapping is 
completely locally Lipschitz with respect to x e C^([—r, 0]; S){") and that the con- 
tinuous mapping qi ^ K{t,(p) is locally Lipschitz that k is completely locally Lips- 
chitz with respect to x e C°([-r, 0]; di") with k(t, 0) = for all t > 0. Moreover, it 
should be noticed that, if the ORCLF V and the function 'I^ involved in property (ii) 
of Definition 6.3 are time independent, then the partition of unity arguments used 
above may be repeated on :— {q) e di^ : c'cp ^ 0} instead of := (— 1, +oo) x 
{qi e S)i^ : c'(p ^ 0}. This implies that the constructed feedback is time invariant, 
provided that the mappings (P — (Pi, ..., 0p)' : S)i+ x C^i[-r, 0]; Df) -^ ^iP and 
K : A—^ U are time independent too. 

Exploiting the properties of the mappings S : (—1, +oo) x dV x U ^ di U 
i+oo] and ip : m+ x ^P x U ^ di U {+oo}, inequalities (6.224), (6.249), def- 
initions (6.244), (6.252), and the fact that the mapping cP = (0i,...,0p)' : 
9{"'" X C'^([—r,0]; di") -^ Sit'' involved in property (ii) of Definition 6.3 satisfies 
0i(t,x) :— V(t,x), we may establish (exactly in the same way as in the proof of 
Theorem 6.4) the following inequality: 

V°{t,x;f{t,d,x,kit,x)))<-^p{V(t,x)) 
V(r, jc, rf) e i){+ X di" X D (6.255) 

The fact that system (1.10) with u = kit, Tr(t)x) is URGAOS follows directly from 
Theorem 2.5 in Chap. 2 and inequality (6.255). 

(b) ^ (a) Since for every bounded ^ C 3{+ x C'^d-r, 0]; S){"), 

\k(t,x)-k(t,y)\ 1 

-^ -■.it,x)e^, it,y)e^, x^y] <+oo 



sup 

I 11-^ ~ y\\ 

we have that the closed-loop system (LIO) with u — kit, Tr(t)x) satisfies hy- 
potheses (Sl-5). For each (tQ,xo,d) e Dt+ x C°([-r, 0]; SH") x Md, we denote 
by x(t, to, XQ, d) the solution of (LIO) with u — k{t, Tr{t)x) and initial condition 
Trito)x — XQ corresponding to d e Mo- 

Since system (LIO) with u — k(t, Tr(t)x) is RFC, it follows from Lemma 2.7 in 
Chap. 2 that there exist jl, P G A"*" and a e Kqq such that the following inequality 
holds for all (to, xq, d) e S1t+ x C°([-r, 0]; Sit") x Mq: 

P'(t)\\x\\r<a{P{to)\\xo\\,.) Wt>to (6.256) 

Using Lemma 3.2 in Chap. 3, we can conclude that there exist jl, P e K'^ 
and a e Koc such that the following inequality holds for all (to,xo,d) e Dt"*" x 
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C°([-r,0];S)t")xMz): 

^^(t)\\x\\r < P(to)a{\\xo\\r) Vf>fo (6.257) 

Without loss of generality, we may assume that P e K~^ is nondecreasing. 

Since system (1.10) with u = k{t, Tr(t)x) is URGAOS, it follows from (6.257) 
that the system 

i(f) = /(f, d(t), Tr{t)x, k[t, Tr{t)x)) 

Y{t)^\H(t,x)\y + ii{t)\\xl. 

x{t) e m", Y(t) e S){, d(t) e D (6.258) 

where /x(f) :— exp(-0^, satisfies hypotheses (Sl-5) and is URGAOS. Notice 
that system (6.258) is the closed-loop system (1.10) with u — k(t, Tr{t)x) and output 
defined by Y(t) — \\H{t,x)\\y + fji{t)\\x\\r. It follows from Theorem 3.6 in Chap. 3 
that there exist functions ai,a2e Koo and a mapping V : Di"*" x C'^([—r, 0]; i)i") -^ 
Dt"*", which is almost Lipschitz on bounded sets, such that 

ai{\\H(t,x)\\y + fi(t)\\x\\r) <V(t,x) <a2{\\x\\r) (6.259) 

V°{t, x; f{t, d, X, k(t, x))) < -V(t, x) (6.260) 

for all it,x,d) e di+ x C°([-r,0]; di") x D. The rest of the proof is exactly 
the same as the proof of implication (a) => (b) of Theorem 6.4. The only ad- 
ditional thing that should be noticed is that the mappings — (0i, . . . , (pp)' : 
m+ X C°([-r,0]; m") -^ 'MP, r] e K+, and A 3 {t,(p) -^ K(t,q)) e U may be 
selected so that (6.241) holds, ri(t) = 1, and K(t, (p) :— Pruifi) for all (t, cp) — 

it,(pi,ip2y em+ xmxM"'. 

The proof is complete. D 



6.6.5 Finite-Dimensional Discrete-Time Systems 

In this section we consider discrete-time systems of the form (4.56) under hy- 
potheses (LI -5) with X = S){", y = di'', and U = S)t'", for which the control set 
U C.U — W^ is a closed convex set. 

We next give the definition of the notion of Output Robust Control Lyapunov 
Function for discrete-time systems. The definition is in the same spirit with the def- 
inition of the notion of Output Robust Control Lyapunov Functions for continuous- 
time control systems. 

Definition 6.4 We say that (4.56) under hypotheses (Ll-5) with A' = SR" , 3^ = SR^ 
and U — iH™ , for which the control set t/ C iY = ilt"' is a closed convex set, admits 
an Output Robust Control Lyapunov Function (ORCLF) if there exists a continuous 
function V : Z"*" x di" -^ di~^ (called the Output Robust Control Lyapunov Function) 
which satisfies the following properties: 

(i) There exist ai,a2& Koo and p e K^ such that 

ai{\H{t,x)\)<V{t,x)<a2{P(t)\x\) V(f,x) e Z+ x *){". (6.261) 
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(ii) There exist functions p e K with p{s) < s for all i > 0, ^ e C^{Z'^; Dt"*") with 
linif ^ +00 lit) — 0, and an upper semi-continuous function 'I^ : Z"*" xdi" xU ^ 
di with t^(f, 0, 0) = for all t e Z+, which is quasi-convex with respect to 
u e U, such that the following inequalities hold: 

supV{t+l,f{t,d,x,u))<<P(t,x,u) V(t,x,u)eZ+ xm" xU (6.262) 
deD 

inf iPit, X, u) < V(t, x) - p(V(t,x))+q(t) V(?, jc) e Z+ x S){" (6.263) 
ueU 

In the case H(t, x) = x, we simply call V : Z+ x di" -^ di~^ a State Robust Control 
Lyapunov Function (SRCLF). 

Remark 6.3 If the mapping u ^ V(t + I, f(t,d,x,u)) is (quasi-)convex for each 
fixed (t,x,d) e Z"*" xdi" x Z), then the mapping u -^ sup^g^ V{t+l, f(t,d,x, «)) 
is (quasi-)convex for each fixed (t,x) e Z+ x di" . It follows that property (ii) of 
Definition 6.4 is satisfied with 'I^(t, x, u) :— sup^g^ V(t + 1, f{t, d, x, u)). 

The following results show how the existence of an ORCLF is related to the 
existence of a stabilizing feedback for (4.56). 

Proposition 6.1 Consider system (4.56) under hypotheses (Ll-5) with X — ?ft", 
y — Sir , and U — SW" , for which the control set U C.U — Sif" is a closed convex set. 
Then the following statements are equivalent: 

(a) System (4.56) admits an ORCLF. 

(b) There exists k e C°°{Z'^ x ^H"; U) such that the closed-loop system (4.56) with 
u^k(t,x) isRGAOS. 

(c) There exists k e C {Z~^ x di"; U) such that the closed-loop system (4.56) with 
u^k{t,x) isRGAOS. 

Proposition 6.2 Consider system (4.56) under hypotheses (Ll-5) with X — 'dV^ , 
y — Sir , and U — !W" , for which the control set U C.U — S){'" is a closed convex set. 
Then the following statements are equivalent: 

(a) System (4.56) admits an ORCLF, which satisfies (6.261) with P(t) = 1 
and (6.263) with q(t) = 0. Moreover, there exist mappings rj e K'^ and 
K e CiA; U), where veZ+ and A^ Ur=o.i,...{'} x {x e DJ" : \x\ < Ari{t)}, 
with K(t,0) — Ofor all t >0 and such that 

<p{t,x,K(t,x)) < V(t,x)- p{V{t,x)) 
for all (t, x)eZ+ X Sit" with \x\ < 2r]{t) (6.264) 

where ^ : SW"*" x S)i" x [/ — >• SW is the mapping in property (ii) of Definition 6.4. 

(b) There exist k e C'"{Z'^ x S){"; U), v e Z"*", such that the closed-loop sys- 
tem (4.56) with u — k{t, x) is RGAOS. 

From the proof of Proposition 6.2 it will become apparent that if statement (a) of 
Proposition 6.2 is strengthened so that the ORCLF V, the mappings 'F involved in 
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property (ii) of Definition 6.4, and the mapping K : A ^ U are time independent, 
then the continuous mapping k, whose existence is guaranteed by statement (b) of 
Proposition 6.2, is time invariant. 

Proof of Proposition 6.1 (a) ^ (b) Suppose that (4.56) admits an ORCLF. With- 
out loss of generality, we may assume that the function q e C^{Z^; ^H"*") with 
lim,^-(_oo?(?) — involved in (6.263) is positive for all t e Z+. We proceed by 
noticing some facts. 

Fact I For all (t, xq) e Z"*" x S)i", there exist uq e U and a neighborhoodN(t , xq) C 
S)f' such that 

xeN(f,Jt:o) =^ ^{t,x,UQ)<V{t,x)- p{V{t,x))+Aq{t) (6.265) 

Moreover, ifxQ — 0, then we may select mq = 0. 

Proof of Fact I By virtue of (6.263) and since q(t) > for all t e Z"*", it follows that 
for all (?, xo) e Z"*" x di" , there exists uq e U such that 

•^(f , -^o, mo) < Vit, xo) - p{V(t, xo)) + 2q{t) (6.266) 

If XQ = (and since 'Pit, 0, 0) = for all t e Z"*"), then we may select uq — 0. 
Since the mapping x ^ tf'(f , x, m) is upper semi-continuous and the mapping x e 
Dt" —>■ V{t,x) — p(V(t,x)) is continuous, there exists a neighborhood N(f,xo) C 
9{" around xq such that, for all x e N(?, xo), 

'P(t, X, Mo) < i^(f , Xo, Mo) +q(t) 

(6.267) 
y (f , xo) - p{V(t, xo)) < V(t, x) - p(y (f , x)) +q(t) 

Inequalities (6.266) and (6.267) imply property (6.265). 

Fact II For each fixed t e Z"*", there exists a family of open sets (i2 : ) jej(t) with 
i2 ■ C SH"\{0}/oi" all j e /(f), which is a locally finite open covering ofdi"\{0}, 
and a family of points (m ■ )jej(t) with u : e U for all j e J(t) such that 

xe^f =^ >P{t,x,uf)<V(t,x)-p{V(t,x))+4-q(t) (6.268) 

This fact is an immediate consequence of Fact I. 

By virtue of Fact II and standard partition of unity arguments, it follows that for 
each fixed t e Z"*", there exists a family of smooth functions 6q . ^i" ^- [0, 1], 6 : . 

m" -^ [0, 1], with efix) = if X ^ Qf' C M"\{0} and e^'\x) = if x ^ N(f, 0), 
where N(f , 0) C J)t" is the neighborhood provided by Fact I for xq = and mo = 0, 
^o'^(^) + T,jeJ(t) ^fM being locally finite and such that O^^kx) + J^j Oj'\x) = 1 
for all X e S){" . We define, for each fixed t e Z~^, 

k{t,x):^ Y] 0f\x)uf (6.269) 

jeJ(t) 
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Clearly, k as defined by (6.269) is a smooth function with k(t,x) e U (since U is 
convex and kit, x) is equal to a convex combination of u , e U and uo — Oe U). 
Notice that ^ Q ^ for all j e J(t), and consequently by definition (6.269) we 
have k{t,Q) — for all t e Z"*". From the fact that ^ is quasi-convex with respect to 
u e U and from definition (6.269) it also follows that 

W(t,x,k{t,x))^^it,x, V e'-'\x)u'''A < max \^ (t , x , u^'^)\ (6.270) 

where J'it, x) = {; e /(r) U {0}; 0j'\x) / 0} is a finite set. For each ; e J'{t, x), 

we obtain that x e f2 ■ or x e N(t, 0). Consequently, by (6.268) or (6.265) we have 

that <;'(?, x,M*.'') < V(t,x)- p(Vit,x)) + 4q{t) for all y e /'(f, x). Combining the 
previous inequality with inequality (6.262), we conclude that the following property 
holds for all (t,x,d) e Z+ xdl" x D: 

V{t+l,f{t,d,x,k(t,x))) < 1^{t,x,k(t,x)) 

<V{t,x)-p{V(t,x))+4q(t) (6.271) 

It follows from (6.271) and Proposition 2.3 in Chap. 2 that system (4.56) with u — 
/fc(r,jc)isRGAOS. 

(b) => (c) Trivial. 

(c) => (a) Since system (4.56) with u — k{t, x) is RGAOS and satisfies hypothe- 
ses (Ll-4), it follows from Proposition 3.1 in Chap. 3 that there exists a continuous 

V : Z"*" X S1{" -^ di~^ and functions ai, 02 e Koc and p e K^ such that inequal- 
ity (6.261) holds and, for all (f , x, d) e Z+ x m" x D, 

V{t+l, f{t, d, X, k(t, x))) < exp(-l)y(f , x) (6.272) 

We next prove that V is an ORCLF for (4.56). Obviously, property (i) of Defini- 
tion 6.4 holds. Define 

<P(t,x,u) :— sup{y(f -I- 1, F{t,x,d, v);deD,veU, \v- k(t,x)\ 

< \u-kit,x)\} (6.273) 

Inequalities (6.262), (6.263) with p(s) :— (1 — exp(— 1))^ and q(t) = are immedi- 
ate consequences of inequality (6.272) and definition (6.273). Finally, we prove that 
the function ^ as defined by (6.273) is quasi-convex with respect to u e U. Notice 
that the continuous maps f : Z+ x D x m" x U ^ di'\ k:Z+xdV'^U, and 

V ■.Z+ X SH" -^ ;)i+ can be continuously extended to f :m x D x m" x U ^ d\", 
k-.mxm" ^ U, and V :dlx dl" -^ dl+, respectively. Under hypothesis (L5), it fol- 
lows from the compactness of D C S)t' , the continuity of / : Dt"*" x D x di" x U ^^ 
d\'\ k:d^+ X M" -^ U, and V : 9t+ x Dt" -^ ;)i+, and Theorem 1.4.16 in [4] that the 
function 'I^ as defined by (6.273) is continuous. Clearly, definition (6.273) implies 
^(t, 0, 0) = for all t e Z+. Let (r, jc) e Z+ x dV\ mi, m2 e C/, and X e [0, 1]. Then 
(6.273) implies 
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<P{t,x,Xu[ + (1 -X)U2) 

<sup{y(r + l,F(t,x,d,vy,deD,ve U), 

\v — k(t , x)\ <Ami — k(t, x)\ + {I — X)\u2 — kit, x) 1 

<sup{y(r + \,F{t,x,d,v))\deD,veU, 

\v\< max{|Mi — ^(f, x)|, |m2 — ^(?,x)|}} 

If max{|Mi — k{t, x)\, \u2 — k(t, x)\} — \ui — k{t, x)\, then the above inequality im- 
plies <P{t,X,Xui + (1 - k)U2) < 1'it,x,ui). 

Similarly, if max{|Mi —k(t, x)\, \u2 — k(t, x)\} — \u2 — k(t, x)|, then ^(t, x, Xui + 
(1 — k)u2) < ^(t,x, U2)- Thus, in any case, it holds that 'P(t,x, kui + (1 —X)u2) < 
max{^{t, X, Ml), <P(t, X, M2)}. The proof is complete. D 

Proof of Proposition 6.2 (a) =► (b) Suppose that (4.56) admits an ORCLF which 
satisfies (6.261) with /S(f) = 1 and (6.263) with q(t) = 0. We proceed by noticing 
some facts. 

Fact I For all it, xq) e Z"*" x (i1{"\{0}), there exists uq E U and a neighborhood 
N(r, xo) C Sir such that 

xeN(f,xo) ^ i//(r,x,Mo) < y(f,x)- -p(y(f,x)) (6.274) 

Proof of Fact I By (6.263) it follows that for all (r,xo) e Z+ x (S1{"\{0}), there 
exists UQ e U such that 

ip(t, xo, Mo) < V(t, xo) - -p{V(t, xo)) (6.275) 

Since the mapping x ^- tf'(f , x, m) is upper semi-continuous and the mapping x e 
8t" — ^ V{t,x) — p(V(t,x)) is continuous, there exists a neighborhood N(f,xo) C 
9{" around xq such that, for all x e N(?, xo), 

<Pit, X, mq) < ^(t, xo, Mo) + 2P{V(t, xo)) 

"^ (6.276) 

Vit, xo) - ^p{Vit, xo)) < Vit, x) - ^p(y (f , x)) 

Inequalities (6.275) and (6.276) imply property {6.21 A). 

Fact II For each fixed t e Z+, there exists a family of open sets (Q ■ )j£j(t) with 
Q : C !W"\{0}/or all j e /(O^ which is a locally finite open covering o/S)t"\{0}, 
and a family of points (m • )jeJ{t) with u ■ e U for all j e 7(f) such that 

xeQf =^ <P{t,x,u'^p)<V(t,x)--p{Vit,x)) (6.277) 

This fact is an immediate consequence of Fact I. 
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By virtue of Fact II and standard partition of unity arguments, it follows that 
for each fixed t e Z"*", there exists a family of smooth functions : 9{" — >• [0, 1] 

with ef\x) = if X ^ ^f^ C S)i"\{0}, E,/ey(r)^f' (^) being locally finite with 
J2j ef (x) = 1 for all X e S){"\{0}. We define, for each fixed t e Z+, 

(6.278) 
where 

k(t,x):^ Y^ df{x)iif forfeZ+,x^O (6.279) 

,/e-/(0 
k(t, 0) := for f > (6.280) 

where h e C°°(d{; [0, 1]) be a smooth nondecreasing function with h(s) — for 
all J < and his) = 1 for all s>l, and Q(t) = {x e m" : |x| < 3??(r)}. Clearly, /fc 
as defined by (6.278), (6.279), and (6.280) is a function of class C''{Z+ x 9f'; U) 
with k{t, x) e U (since U is convex and k{t, x) is equal to a convex combination of 
uy eU and UQ — Oe U). It can be shown (by distinguishing cases) that 

^{t,x,k{t,x))< Vit,x)- -p{V{t,x)) 

for all {t,x) e Z+ x !){" . It follows from the above inequality and Proposition 2.3 in 
Chap. 2 that system (4.56) with u = k(t, x) is URGAOS. 

(b) =► (a) Since system (4.56) with u — k{t,x) is URGAOS and satisfies hy- 
potheses (Ll-4), it follows from Proposition 3.1 in Chap. 3 that there exist a con- 
tinuous V : Z"*" X ?}{" —^ !1{+ and functions ai , 02 e Koc such that inequality (6.261) 
with j6(r) = 1 holds and 

V{t+l,f{t,d,x,k(t,x))) <exp(-l)y(f,x) 
V(r, X, d)eZ+ X iU" x D (6.281) 

We next prove that V is an ORCLF for (4.56). Obviously, property (i) of Defi- 
nition 6.4 holds. The reader can verify that the function ^ as defined by (6.273) is 
continuous and satisfies (6.262), (6.263) with g(f) = 0. Moreover, the function 'l^ as 
defined by (6.273) is quasi-convex with respect to u e U. The proof is complete. D 



6.7 Backstepping 

Backstepping is a methodology for constructing control Lyapunov functions or 
functionals in parallel with the construction of stabilizing feedback laws. Backstep- 
ping and its variants are described in detail in [41] and the references therein, and 
share the common feature with the "adding an integrator" results (see [67]) that it is 
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a very powerful tool for the systematic design of controllers for finite-dimensional 
nonlinear systems with a lower triangular structure. Adaptive and robust backstep- 
ping methods are also available in the past literature (see [14, 26, 41] and numerous 
references therein). 

We will describe in detail the backstepping method for a class of infinite- 
dimensional nonlinear systems described by RFDEs and also for a class of finite- 
dimensional discrete-time systems. 



6.7.1 Backstepping for Control Systems Described by RFDEs 

Here, we will study in detail a class of triangular time-delay nonlinear systems de- 
scribed by RFDEs, i.e., 

i,(0 = fi{t, d(t), r,(f)xi, . . . , T,(t)xi) + gi{t, d{t), T,.{t)xu ..., T,(t)xi)xi+i(t) 
i — 1 , . . . , n — 1 

Xnit) = fn{t,d{t), Tr{t)x) + gn{t,d(t), Tr{t)x)u{t) 

x{t) = [xiit), . . . , xn{t)) e m",d(t) e D, u(t) em,t>0 (6.282) 

Lyapunov-based feedback design for various special cases of systems described by 
RFDEs was used recently in [21, 22, 44, 46, 50, 72], including the input-delayed 
case. More specifically, the stabilization problem for autonomous and disturbance- 
free systems of the form (6.282) has been studied in [21, 22, 50, 72]. 

The following result shows that the construction of a stabilizing feedback law 
for (6.282) proceeds in parallel with the construction of a State Robust Control 
Lyapunov Functional. Moreover, sufficient conditions for the existence and design 
of a stabilizing feedback law u(t) — k(x(t)), which is independent of the delay, are 
given. The result covers the finite-dimensional case too. 

Theorem 6.6 Consider system (6.282), where r > 0, D C 9v is a compact 
set, the mappings fi-.m+xOx C°([-r, 0]; *){') -^ m and gi : 9t+ x D x 
C ([—r, 0]; 9t') -> 9t (/ — !,...,«) are continuous with fi (f , d,0) = for all 
it, d) e m+ X D, and each gi : m+ x D x C°([-r, 0]; di') ^ Dt (; = 1, . . . , «) 
is completely locally Lipschitz with respect to x e C ([— r, 0]; dV). Suppose that 
there exists a nondecreasing function cp e C"'' (!){"*"; (0, +oo)) such that for every 
i — I, . . . ,n, it holds that 

1 

<gi(t,d,x) 



ViUWr) 



<^(||x||,) V(f,x,d)e9{+xC°([-r,0];9J') X £) (6.283) 



Moreover, suppose that for every i — I, . . . ,n, it holds that 
\f{t,d,x)- fi{t,d,y)\ 



sup 



■.{t,d)e'')\'^ X D,xeS,yeS,x^y\ < +oo 



\\x -y\\r 
for every bounded S c C°([-r, 0]; 9i') (6.284) 
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Then, for every cr > 0, there exist functions fii G C°°(!W; (0, +oo)) and ki € 
C'^0\^\){i^\,...,n)with 

^i(§i):=-/xi(ti)ti (6.285) 

kj{Hu...,Hj)-^-l^jiHu...,Hj){Hj-kj-i{Hu...,Hj-i)) j^2,...,n 

(6.286) 

such that the functional 

V(x) := max expi2a0)(x^(0) + ^|x/(6l) - ki-i{xi(0), . . . ,x/_i(6l))|^ ] 

(6.287) 

is a State Robust Control Lyapunov Functional (SRCLF) for (6.282). More- 
over, the closed-loop system (6.282) with u(t) — ^„(x(f)) is URGAS. More 
specifically, the inequality V (x; v) < — 2CTy(jc) holds for all (t,x,d) e Sit"*" x 
C°([-r,Q];di") X D with n = {fi(t,d,xi) + gi(t,d,xi)x2(0), . . . , fn(t,d,x) + 

gn(t,d,x)kn(x(0))yedV\ 

Remark 6.4 It is worth noting that the feedback law u{t) = kn{x{t)) is delay- 
independent. From the proof of Theorem 6.6, the functions /x; e C°^(y{' ; (0, +cxd)) 
(i — 1, . . . ,n) will be obtained by an algorithmic procedure similar to the backstep- 
ping procedure used for finite-dimensional triangular control systems. 

The proof of Theorem 6.6 is based on the following lemma. 

Lemma 6.7 Let Q e C (dl"; Ot"*"), ct > 0, and consider the following functional: 

V : C°([-r, 0]; iU") -^ iU+ with V(x) := max exp(2aO)Q(x(e)) (6.288) 
' eel-i;0] ^ ' 

The functional V : C ([—r,0];di") -^ Si"*" defined by (6.288) is Lipschitz on 
bounded sets ofC^{[—r, 0]; !H") and satisfies 

V°(x;v)<-2aV(x) 

for all (x, v) e C°([-r, 0]; S1{") x DJ" with Q{xiO)) < Vix) (6.289) 
y°(x; i;) < max{-2ay(x), VQ{x(0))v} 

for all (x, v) e C°([-r, 0]; DT) x S)i" with e(x(0)) = Vix) (6.290) 

Proof The fact that the functional V as defined by (6.288) is Lipschitz on bounded 
sets of C°([-r, 0]; f){") is a direct consequence of the fact that Q e C\m"; *){+) 
(details are left to the reader). 
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Clearly, by (6.288) we have 
V{Eh(x\v)) 

= max! max &xv>(2a6)Q{x(6 + h)], 

yee[-r-h] ^ ' 

max exp(2CT0)Q(x(O) + (0 + /!)ii)| 
0e[-/i,O] ^ '\ 



— max 



exp(— 2CT/i) max e\V){2as)Q{x(s)), 

ie[-f+/7,0] ^ ' 



max exp(2cr0) 
ee[-/),0] 



e(x(O)) + (0 + /2)Ve(x(O))i; 



i 






<max{exp(-2cr;!)V(x), max exp(2fT0)[Q(x(O)) + (0 + /!)Vg(x(0))i;] 

+ /!|i;| max |ve(x(0)+.jjj)-ve(jc(0))|| (6.291) 

If g(x(0)) < y(x), then there exists /z > such that G(x(0)) + sV Q{x{{)))v < 
j(V(x) + Qix(0))) for all s e [0, /z]. Consequently, in this case it follows 
from (6.291) that, for sufficiently small h > Q, 



h-\v{Eh{x;v))-V{x)) 
< max 



exp(—2ah) — 1 1 / / x x 

^ ^ y(x),exp(-2a/z) — (e(x(0)) - V(x)) 



+ \v\ max |ve(x(0) + 5i;)- Ve(x(0))| 
se[0,h] 

The above inequality gives (6.289) for the case Q(x(0)) < V(x). 

If e(x(0)) = y(x) and VQ(x{0))v > -2aV{x), then it follows that, for suffi- 
ciently small h > 0, 

m_ax exp(2CT(?)[e(x(0)) + (B + h)V Q{x(Q))v] = e(x(0)) + /!Ve(x(0))i;. 
Consequently, from (6.291) we obtain 
h-\v{Eh(x;v))-V(x)) 
< max 



e\pi-2ah) - 1 , , , 
— y(x), 



h 

Ve(x(0))i;+|i;| max \V Q{x(0) + sv) - VQ{x(0))\ 
selOJi] 

The above inequality gives (6.290) for the case Q{x(0)) = V(x) and S/Q(x(0))v > 
-2(7 V(x). 
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If e(x(0)) = V(x) and S/Q{x{0))v < -2aV{x), then it follows that, for suffi- 
ciently small h > Q, 

max exp(2(T 0)[Q{x (0)) + {9 + h)S/ Q{x(0))v]^ exp{-2ah)Q{x(0)) 

Consequently, from (6.291) we obtain 
h-\v{Eh(x;v))-V(x)) 

^ exp(-2g/i)-l ^^^^_^ max \V Q(x(0) + sv) -V Q(x(0))\ 

The above inequality gives (6.290) for the case 2(x(0)) = V (x) and Vg(x(0))i; < 
-2o-y(x). 

The proof is complete. D 

We are now in a position to provide the proof of Theorem 6.6. 

Proof of Theorem 6.6 Inequality (6.284), in conjunction with the fact that 
fi(t,d,0) — for all (t,d) e 9{"'" x D (i — 1, . . . , n), implies the existence of a 
nondecreasing function L e C°° (!){"*"; (0, +oo)) such that for every / = 1, . . . , n, it 
holds 

\fit,d,x)\ <L(||x||,)||x||^ V(r,x,^)e!1{+ x C°([-r,0]; ilt') x D (6.292) 

Let a > be a given number. We next define functions /x, e C°°{dl' ; (0, +oo)), y, e 
C~(*){+; (0, +oo)), and bj e C~(*){+; (0, +oo)) (/ = !,...,«) using the following 
algorithm. 



Algorithm Step i — I: Define 



yi(l + ^l) + n<j 



Mi(gi):^ ' ; /' ; (6.293) 

^i(l + ?f) 



where 



y[(s) :— sxp((jr)L[sexp(ar)) + (p[sexp(ar)^ (6.294) 

bi(s):^- ^— — (6.295) 

(p(sexp(ar)) 

Step ( > 2: Based on the knowledge of the functions fij e C°°(SH'; (0, +oo)) 
(j — l,...,i — 1) from previous steps, we define the function fii e 
C°° (*){'■; (0, +oo)). First define 

^0 = ^i(§i):=-/xi(ti)?i (6.296) 

kji^i, ..., ^j) := -M./(^i, . . . , ?./)(t/ - ^i-i(^i, . . . , §./-!)) y = 2, . . . , i - 1 

(6.297) 
Yj (s) :— exp(ar)L[s exp(ar)Bj [s exp(ar)))Bj [s exp(crr)) 

+ ^(iexp(crr)B/(sexp((Tr))) 7 = 1, . . . , ( (6.298) 
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1 



(p(s exp(ar)Bj (s exp(crr))) 



7 = 1, 
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(6.299) 



where Bj e C°°(d\~^; (0, +oo)) (j — I, . . . , i) are nondecreasing functions that sat- 
isfy 



Biis):^l 



j-i 



Bjis)>max\l + y^ ixi(^i,...,^i): max 1^/ - ^/_i(^i, . . . , §/_i)| < i 



for all 5 > and j >2 



(6.300) 



Let pj e C°°idi+;(0,+oo)) (j = 1,...,/) and Sj e C°°idiJ; (0,+oo)) (j = 
0, . . . ,i — 1) be functions such that the following inequalities hold: 

bj (s') - bj (s) + syj (s) - s'yj (s') < (s - s')pj (s) Ws>s'>0 (6.301) 



S/(?i,...,?,)>|Vfc,(§i,...,§,)|(l + /xi(?i) 
V(^i,...,^j)em-' 



■M,(?i,...,?y)) 

(6.302) 



Define 



/x,(?i,.--,^,):=^"'(p) 

+ yi(p) + Ci_i(p)Si_ii^i 



/-I 



(n+l-i)a + — — a (p, §i, . . . , §/_i) 
4ct 



•^j-i) 



(6.303) 



where 



i 1 



J2\ij-kj-ii^i,...,ii-i)\ 



./=i 



Cq; 



:0 cj(i):=^>'i(i) for7 = 1,...,/ 



(6.304) 



k=l 



a{s,^i, ...,|,_i) 

:=c,_i(.j)(5,_i(fi, ...,|,_i) + Q(j') 



(-1 



(-1 



1 + ^(^M./(?i, • • ■ , §,/) + 5/-i(ti, . . . , t/-i)) I ^P^(^) (6.305) 



/(:=1 



It should be noticed that in every step / > 2 of the above algorithm, we only 
need to compute the functions yi(s), bi(s), Bi(s), p,_i(i), (5,_i(^i, . . . , §i_i), and 
/x,(^i, . . . , ^i) (the functions yj(s), bj(s), Bj(s), pj-i(s), 5,-i(ti, . . . , t/-i), and 
/Xy(fi, . . . , I/) for 7 = 1, . . . , i — 1 have been computed in the previous steps). It 
can be shown by induction that the following claim holds. 
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Claim The following inequality holds for all (^i , . . . , ^,)' e Dt' : 



sJ2\^i-kj-,i^u...,^j-i)\yj(s) 



,/=l 



■ '? ^ |t/ - ^./-i(?i, • ■ ■ , ?j-i)|cy-i(i')(5/_i(^i, . . . , ^;_i) 



,/=i 



-(« + 1 - /)a ^ If; - ^;_i(§i, . . . , §^_i)|' (6.306) 



where 



^^J2\^j-kj-ii^i,..-,^j-i)\ 

CO = (6.307) 

;' 
(^ji^y-^'^Ykis) for j ^\,...,i 

k=l 

By Lemma 6.7 it follows that the functional V defined by (6.287) satisfies 

V°(x;v)<-2aV{x) (6.308) 

for all (t,x,u,d) e ;)i+ x C°([-r,0];'M") x di x D with V(x) > jc2(0) + 
j:"j=2\^j(0)-kj-i(xA0),...,Xj-i{0))\^andv^{fi(t,d,xi) + gi(t,d,xi)x2(0), 
..., fn (t, d, x) + g„ (t, d, x)u)' e S)r, and 

y°(x; v) < max{-2aV(x), 2A(t, d, x, u)} (6.309) 

for all (t,x,u,d) e !)i+ x C°([-r,0]; M") x m x D with V(x) = x^^(O) + 
J:"j^2\xj(0)-kj-i(xi(0),...,xj-ii0))\^andv^{fi(t,d,xi) + gi(t,d,xi)x2(0), 
..., fn(t,d,x) + gn(t,d,x)u)' e 9T, where 



A(r, d, X, u) 

n-l 

:= ^(xj(0) - A:/_i(xi(0), . . . , x;_i(0))) (/,(?, J, xi, . . . , x,) 



n-l 



+ g,- (f , rf, XI , . . . , x;)x,+i (0)) - Y,{xj (0) - kj-y{xi (0), . . . , X/_i (0))) 

./=2 
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+ giit,d,xi,...,xi)xi+i(0)) I 

+ (x„(0) - fc„_i (xi (0), . . . , x„_i (0))) (/„(f , fif, x) + gn(t, d, x)u) 

n-l p., 

- (x„(0) - ^„-i(xi(0), . . . , x„_i(0))) ^^^(-^1(0), . . . ,x„_i(0)) 

z=i ^' 
X (//(f, d,xi,...,xi) + giit,d,xi,..., xi)xi+i(0)) (6.310) 

By virtue of the previous claim, it can be shown that for all (t,x,d) e di~^ x 
C°([-r,0];9r) x D with u = Jt„(xi(0), . . . , x„(0)) and y(x) = xj(Q) + 
12"i=2 1^/(0) ~ ^/-i(^i(0), • • ■ ,Xy_i(0))p, the following inequalities hold: 

n 

Ait,d,x,u)<-aJ2\xj(0)-kj-i{xiiO),...,Xj-i(0))\^ (6.311) 
max y^\xi(e)\<sBi(s) (6.312) 

8e[-rM ' 

with s = exp(ar) Ey=i k,/(0) - ^,-i(xi(0), . . . , x;_i(0))|. 

Consequently, by virtue of (6.308), (6.309) and (6.311), we obtain 

V°(x;u)<-2CTy(x) (6.313) 

for all (t,x,d) e m+ x C°([-r,0]; i){") x D with v = (/i(r,^,xi) + 
giit, d, xi)x2(0), ...,/„(?, fif, x) + gn{t, d, x)k„(x(Q))y e di". 
Notice that there exist functions a\,a2& Koo such that 

n 
«l(l?l)<^f + ^|?,-^,/-l(?l,...,?,/-l)|' 

<«2(l?l) V^ = (ti,...,t„)'e9{" (6.314) 

Consequently, definition (6.287), in conjunction with (6.314), implies 

exp(-2CTr)ai(||x||,) <y(x)<a2(lklL-) Vx e C°([-r, 0]; *){") (6.315) 

It follows from inequalities (6.313), (6.315) and Theorem 2.5 in Chap. 2 that the 
closed-loop system (6.282) with u{t) — k„(x(t)) is URGAS. 

Finally, we show that V as defined by (6.287) is an SRCLF. Clearly, def- 
inition (6.310), in conjunction with (6.311), implies, for all (t,x,u,d) e di~^ x 
C°([-r, 0];9{") x d\ x D with V(x) = x2(0) + E'/=2l^./(0) " Jt/-i(xi(0), 
...,xj_i(0))|2. 
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A(t, d, X, u) 

< -oixliQ) + J2 \xj(0) - kj-i{xi{0), . . .,x,_i(0))n 

+ \xn{0) - k„_i{xi(0), . . . , x„_i(Q))\\g„(t, d, x)\\u - k„{xi(0), . . . , Xn{Q))\ 

(6.316) 
By virtue of (6.283), (6.298), (6.308), (6.309), (6.312), and (6.316), we obtain 
V°(x; v) 

<-2aV(x) + 2\xn(0)-k,-i{xiiO),...,Xn-i(0))\\u-k,{xi(0),...,Xn(0))\ 

XK„(|xi(0)| + ^|x/(0)-fc,_i(xi(0),...,x,_i(0))|J (6.317) 

for all (?, X, u, d) e m+ x C°([-r, 0]; !1f') x^x D with 

V = {flit, d, xi) + gi(t, d, xi)x2(0), ...,fn(t, d, x) + g„(t, d, x)u)' e 9t" 
Define 

0(t,x) :—x(0) p(w) :—2aw, 
and 
•//(r, z, u) := 2\zn - K-\izi ,■■■, z„-i)| 

X Yni kil + X!l^-'' -kj-\izi, ...,zj-i)\ \\u-k„(zi, ■■■,Zn)\- 

These definitions, in conjunction with inequalities (6.315) and (6.317), guarantee 
that inequalities (6.221), (6.222), and (6.223) hold (with q{t) = 0) for V as defined 
by (6.287). Consequently, V as defined by (6.287) is an SRCLF. The proof is com- 
plete, n 

Proof of Claim in the proof of Theorem 6.6 The proof is made by induction. It 

is straightforward to verify that definitions (6.293), (6.294), and (6.295) guarantee 

that (6.306) holds for i — \. We next assume that inequality (6.306) holds for / — 1 

(/ > 2), i.e., 

1-1 

\2, 



i-\ 

(-1 
'Y}Hj-kj-i{^u...,Hj-i)\cj-i{s')&j-i{^i,...,^j-i) 






s 
<-in + 2-i)a\Y\ii-kj-ii^u..-,^j-i)n (6.318) 
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where 

1-1 

^'=EI^^-^./-i(^i'---'^./-i)l 

CQ = (6.319) 

J 
Cj(s)-^^yk(s) for j ^l,...,i-l 
k=i 

By virtue of inequalities (6.301), (6.318) and definitions (6.307), (6.319), we obtain, 
forall(ti,...,f,)'ea{'. 



■J2{^j - kj-ii^u ..., ^j-i)fbj(s)nji^i, ..., ^j) 



./=i 



■J2\ii-kj-ii^i,...,^j-i)\Yjis) 



j=i 



;=i 

<-{n + 2-i)a\Y}^j-kj-i{H\,---,Hj-^)A 

-(t,-A:,_i(§i,...,|,_i))' 

X (fe,C?)/x,(ti, . . . , ^/) - Yiis) - c,_iCs)5,-i(?i, . . . , ?;-i)) 

/-I 

+ \^i-ki-,{Hu---,Hi-iMs,Hu---,Hi-i)Y}^j-kj-i(Hu...,Hj-i)\ 

(6.320) 

where «(.?, ^i, . . . , ^i-i) is defined by (6.305). Using (6.320) in conjunction with 
the inequality 

(-1 
\^i - ki-i(^i, . . . ,^i-i)\^\^j - kj-i(^i, . . . ,^j-i)\aj{s,^\, . . . ,^i-i) 

/-I 
+ |f,-Vi(?i,.--,?,-i)|'^a'(^,?i,...,^,-i) 
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and the fact that the maps s -^ a{s, fi, . . . , ^,_i), i -^ bi(s) are nondecreasing and 
nonincreasing, respectively, on iH"'", it is not hard to verify that definition (6.303) 
guarantees inequality (6.306). Notice that the following inequality is also used: 

' ■ 1 ' 

^^T.\^J-kj-ii^i,..-,^j-i)\<P^':^ + ^J2\^j-kj-ii^u...,^j-i)t 

The proof is complete. D 

Proof of inequalities (6.310) and (6.311) Notice that by virtue of definitions (6.296) 
and (6.297), for all ; > 1 and (§i , . . . , §,)' e dV , it holds: 

i 

+ ;^/X;_i(?i, . . . , ^j-i)\^j-i - kj-2{Hu ■■■, ^j-2)\ (6.321) 

7 = 1 

Inequality (6.321) implies 

X]llyl<(^(l + Mj(?i,..-,?i-i))) max |?,-A:y_i(ti,...,t/_i)| (6.322) 

Definition (6.287) implies that, for all x e C°([-r,0]; i)r) with V{x) = 
E';=i k,/(0) - ^;-i(^i(0), . . . , ^,,--i(0))|2, we have 

max Uj(0) — kj-i(xi(9), . . . ,Xj-i(6))\ 
ee[-'-,0] 

n 

< exp(ar) Y}^.i (0) - kj-i{xi (0), . . . , x,_i (0)) | (6.323) 

./=i 
Inequality (6.311) is a direct consequence of (6.300), (6.322), and (6.323). Con- 
sequently, (6.283) and (6.292), together with (6.311), imply, for all i > 1 and 

(f , x, d) e m+ X C°([-r, 0]; m") X D with V(x) = Y!]=i k./ (0) - kj-\(x\ (0), . . . , 
xy-i(0))|2, 

\fi{t,d,x\, .. . ,Xi)\ < L{^s e.xp(ar)Bi[s e\p(ar)^^Bi[s exp(ar))s exp(cjr) 

(6.324) 

— ; — -^—. ; — -- < gi (t,d,xi,..., Xi) <(p(s e\piar)Bi (s exp(crr))) 

^(sexp(crr)B/(sexp(crr))) 

(6.325) 
where 

n 

s := J2\^j(0) - kj-i{xm, ■ ■ • ,^./-i(0))| (6.326) 

./=i 
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Using (6.324), (6.325), we obtain, by virtue of definitions (6.298), (6.299), 

\fi{t,d,xu ...,x,)| + \gi{t,d,x\, ...,x,)||x,+i(0) -^,(xi(0),...,x,(0))| 
<syi{s) / = !,...,« -1 (6.327) 

\fn{t,d,X\_,...,Xn)\ <SYn{s) (6.328) 

bi{s)<gi{t,d,xy,...,Xi)<Yi(s) / = !,...,« (6.329) 

where s is defined by (6.326). Definition (6.310), in conjunction with definitions 
(6.296) and (6.297), gives, for u = /fc„(xi(0), . . . , x„(0)), 

A{t,d,x,u) 

n 

■ ^ gi (t,d,xi,..., Xi)fij [x\ (0), . . . , Xj (0)) 



n 
< 



x(x,(0)-^,_i(xi(0),...,xy_i(0)))' 

n-1 

+ ^|x/(0)-fc,_i(xi(0),...,x,_i(0))| 

X \fj{t,d,x\, . . . ,Xj) + gj{t,d,xi, . . . ,Xj) 
x{xj+i(0)-kj{xi(0),...,xj(O)))\ 

n-\ 

+ ^|Vfc,_i(xi(0),...,x,_i(0))||xy(0)-fcj_i(xi(0),...,x,_i(0))| 
j=l 

;-i 
X ^|/z(^<i,-xi, ...,x/) + g/(f,fif,xi,...,x/) 

x(x,+i(0)-^,(xi(0),...,x,(0)))| 

n-l 

+ ^|V^,_i(xi(0),...,x,_i(0))||x,(0)-^j_i(xi(0),...,x,_i(0))| 

J=2 

;-i 
x^|x,(0)-^/_i(xi(0),...,x,_i(0))| 

i=\ 
X /[^z (-^1 (0), . . . , x/ (0)) \gi{t,d,xx,...,xi)\ 
+ |x„(0) - A:„_i (xi (0), . . . , x„_i (0)) 1 1 /„(f , c;, x) I 
+ |V^„_i(xi(0),...,x„_i(0))||x„(0)-A:„_i(xi(0),...,x„_i(0))| 

n-\ 

X ^|/z(^<i,-xi, ...,x/) + g/(f,<i,xi,...,x/) 

x(x;+i(0)-A:,(xi(0),...,x,(0)))| 

+ |V^„_i(xi(0),...,x„_i(0))||x„(0)-/:„_i(xi(0),...,x„_i(0))| 
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n-1 



x^|x,(0)-A:,_i(xi(0),...,x,_i(0))| 



/=1 
X i^,{xi (0), . . . , xi(0)) \g,(t, d,xi,...,x,)\ (6.330) 

Combining (6.330) with (6.326), (6.327), (6.328), and (6.329), we obtain, for u = 

A:„(xi(0),...,x„(0)), 

A(t, d, X, u) 

n 

< - ^ bj (s),ij (xi (0), . . . , x^ (0)) (x; (0) - kj_i{x, (0), . . . , x,_i (0)))' 

7 = 1 
n 

+ sJ2ki(^) - kj-i (^i(O). • • ■ ' x,-i(0)) |k/(^) 

,/=2 

+ ^^|V^^_i(xi(0),...,x,_i(0))||x,(0)-^^_i(xi(0),...,x^_i(0))| 

./=2 

i-1 
x^(l+/x,(xi(0),...,xKO)))y,(i) (6.331) 

Inequality (6.331), together with inequality (6.302), implies, for u — k„{x\{0), 
...,x„(0)), 

A(?, d, X, u) 

n 

<-Y.bj {s)iJij (xi (0), . . . , Xj (0)) (x; (0) - ^/_i (xi (0), . . . , x/_i (0)))' 
7=1 

n 

+ ^^|x;(0)-/:,_i(xi(0),...,xy_i(0))|K,(s) 

./=i 

+ ^^3,_i(xi(0),...,x,-_i(0))|x;(0)-^/_i(xi(0),...,x/_i(0))| 
,/=i 
y-i 
x^K,(^) (6.332) 

/ = ! 

Clearly, inequality (6.332), in conjunction with (6.306) for i — n, shows that (6.310) 
holds. The proof is complete. D 

The following example shows how the backstepping methodology can be used 
for the stabilization of uncertain systems. 
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Example 6. 7. 1 Consider the control system 



'f 

Jt-r 



4' 
ilit) ^ d2(t)\\Tr(t)X2\\^ + u(t) 

{xi (t), X2(t)) e m^, {di (?), ^2(0) e[-l,lf, u{t) e 9t (6.333) 

Clearly, system (6.333) is a control system described by RFDEs, which satisfies 
the hypotheses of Theorem 6.6. More specifically, inequality (6.283) holds with 
^ = 1. In order to design a delay free stabilizing feedback for (6.333), we follow 
the algorithm in the proof of Theorem 6.6. Notice that inequality (6.292) holds with 
L(w) — 1 + rw. Let a > be given. 

Step / = 1 : We define 

Ati(^i) := exp(ar)(l + r(l + ^^) expiar)) + l + 2a (6.334) 

yi (.?):= exp(crr)(l + r.sexp(CTr)) + 1 bi{s) = l (6.335) 
Step i — 2: We define 

ki(^i) := -(exp(ar)(l + r(l + ^f) exp(CTr)) + 1 + 2a)fi (6.336) 
3i(^i) := (exp(CTr)(l + r(l + 3^f) exp((T/-)) + 1 + 2a) 

X (exp(ar)(l + r(l + ff) exp(ar)) + 2 + 2a) (6.337) 

B2(s) := exp(ar)(l + r (l + s^) exp(ar)) + 2 + 2a (6.338) 
y2(s) :— 1 + exp(ar)(l + ir exp(ar)B2(exp(ar)i'))Z?2(exp(ar)i) 

b2(s) = 1 (6.339) 

pi(s) :=exp(ar)(l + 2r s exp(cT r)) + 1 (6.340) 

a(s, ?i) := yi{s)Si(^i) + yi{s) + y2(s) + {l+ sixi{^i))pi(s) (6.341) 



and 



where 



M2(ti, §2) := a + ^a\p, ^i) + y2(p) + n(p)5i(?i) (6.342) 

4a 



p:^l+ ^-Hl +\\b-+ (exp(ar)(l + r(l + ^f) exp(ar)) + 1 + 2a)^i f (6.343) 
The stabilizing feedback law is given by 

u{t) = -IX2{x\{t), X2{t)){x2{t) 

+ (exp(ar)(l + r(l + x\(t)) exp(ar)) + 1 + 2a)xi(0) (6.344) 
By virtue of Theorem 6.6, the functional 
y(x):= max exp(2a0)(x?(0) 

ee[-r,0] 

+ |x2(6>) + (exp(ar)(l + r(l + xliO)) exp(ar)) + 1 + 2a)xi(e)f) 

(6.345) 

is a SRCLF, and system (6.333) with (6.344) is URGAS. 
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6.7.2 Backstepping for Finite-Dimensional Discrete-Time Systems 

In this section we consider triangular discrete-time single input systems (i.e., u e 9{) 
of the form (4.56) under hypotheses (Ll-5) with A" = Sit", 3^ = M*^, and C/ = W = 
9J, for which we suppose that there exist continuous functions Fj : Z+ x JH'"*"' ^• 
9{ (i = 1, . . . , «) with fi (t, 0) = for all r > such that, for all (r, x, u) e Z+ x 
m" X dl, 

f(t, 0,x, m) — (Fi(f,xi, xj), F2it,xi,X2,X3), . . . , F„{t,xi, . . . ,Xn, m)) (6.346) 

The following theorem is the main result of this section and provides sufficient 
conditions for the robust stabilization of system (4.56). 

Theorem 6.7 Consider system (4.56) under hypotheses (Ll-5) with X — W ,y — 
9J , U —U — S1{, and D C 9r being compact with e D and suppose that there 
exist continuous functions Fj : Z+ x di'~^ — >• di (i — I, . . . ,n) with Fi(t, 0) — Ofor 
all t e Z"*" such that (6.346) holds. Furthermore, suppose that there exist continuous 
functions kt : Z"*" x 9{' — >• 9i (;' = 1, . . . , n) with ki (t, 0) — Ofor all t e Z"*" such that 
the following identities hold for all (t, x) e Z"*" x !){": 



Fi{t,xi,ki(t,xi))^0 




(6.347) 


Fi{t,xi,...,xi,kiit,xi,...,xi)) 






^ki-i{t + l,Fi(t,xi,X2),...,Fi-i(t,xi,. 


.,x,)) 




for i — 2, .. .,n 




(6.348) 


Consider the following vector fields defined on Di"*" x dl" : 






F(t,x):^f{t,0,x,kn(t,x)) 




(6.349) 


F(°'(f,x):=x 




(6.350) 


F'-'Ht,x):^F{t + i- l,F^'-^\t,x)) fori 


> 1 


(6.351) 



Let p e C (9{"; f)}"*") be a positive definite function with p(0) = that satisfies 
p{x) > K\x\ for all x e 9t" for certain constant K > 0, and let y > I and /\. e (0, 1) 
be constants. Let D{y, X) C D the set of all d e D that satisfy the following prop- 
erty: ^{t,x) e Z+ xJ){", 

n—\ n—i 

Y^ y'p{F^'\t + 1, f{t, d, X, knit, x)))) < 1^ y'p(F(''(f, x)) (6.352) 

1=0 (=0 

Then the following statements hold: 

(i) For every pair y > 1, />l e (0, 1) with Ay > 1, the set D{y, 1) C £) is a nonempty 

compact set with e D{y, X). 
(ii) For every pair y > 1, 1 e (0, 1) with Xy > I, the closed-loop system (4.56) with 

u(t) — kn(t,x(t)) andd(t) e D{y,X) isRGAS. 
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The main idea that lies behind the proof of Theorem 6.7 is to construct a con- 
tinuous feedback that guarantees the so-called "dead-beat property of order «" (see 
[61]) for the nominal system (4.56) with d — 0. Then by making use of a Control 
Lyapunov Function for the nominal closed-loop system, we establish RGAS for dis- 
turbances that belong to an appropriate set, namely, the set D(y, X) C D. The proof 
of Theorem 6.7 is based on the following lemma, which is similar to Theorem 3.2 
in [61]. 

Lemma 6.8 (Finite-time stabilization and explicit construction of CLFs for triangu- 
lar single-input systems) Consider the single-input discrete-time system 

x{t+ \)^F[t,x{t),u{t)) 

u{t)ey\,xit):^{xi{t),...,xn{t))e':)\", t e Z+ (6.353) 

where 

F{t, X, u) — [F\(t, XI, X2}, F2{t, XI, X2, x^), . . . , Ffiit, XI, . . . ,Xn, u)) (6.354) 

for certain continuous mappings Fi : Z"*" x Dt'"*" -^ 9t (/ = !,...,«) with 
Fi{t,0) = for all t e Z"*". Suppose that there exist continuous functions ki : 
Z"*" X Dt' ^- Ot (i = 1, . . . , n) with ki(t, 0) — for all t e Z"*" such that the iden- 
tities (6.347), (6.348) hold for all (t,x) e Z+ x DT. Then zero is RGAS for the 
closed-loop system (6.353) with u{t) — k„(t, x(t)), namely, the system 

x(t + l)^F{t,x{t)) (6.355) 

where 

F(t,x):^F{t,x,kn(t,x)) (6.356) 

Moreover, the closed-loop system (6.353) with u(t) — k„it,x(t)) {system (6.355)), 
has the dead-beat property of order n, i.e., for every (to, xq) G Z"*" x SW", the unique 
solution x(t) of the closed-loop system (6.353) with u(t) — k„(t,x(t)) and initial 
condition x (to) = xq satisfies 

jc(0 = forallt>to + n (6.357) 

Furthermore, let p e C (di"; yi~^) be a positive definite function with p{0) — that 
satisfies pix) > A'|x| for all x e 9i" for certain constant K > and the vector 
fields (t, a:) e Z+ X at" ^ F<'')(f, x) e Dt" defined by (6.350), (6.351) with F defined 
by (6.356). Then, for every y > I, the continuous function Vy : Z"*" x di" — >• DJ"*" 
defined by 

n-[ 

yy(f,x):=^y'/7(F*''(r,A;)) (6.358) 

is an SRCLF for (6.353). Particularly, for every y > I, there exist functions aj e K^o 
and B e K'^ such that 
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K\x\<Vy(t,x)<a2{P(t)\x\) V(r, x) e Z+ X !ir (6.359) 

Vy{t + l,F(t,x,u))<1^y(t,x,u) V(f,x,M)eZ+ xSir xSR (6.360) 

inf 1'y(t,x,u)<'Py{t,x,kn(t,x))<-Vyit,x) V(t,x)eZ+ xdi" (6.361) 
«e;i! y 

where the function tf'y : Sit"*" x S1{" x 9i — >• SH"*" w quasi-convex with respect to m e J){ 
vv/f/i i/'y (?, 0, 0) — Ofor all t e Z"*" anci w defined by 

^y{t,x,u) :— sup{Vy(t + l,F{t,x,kn(t,x) + v);\v\<\u-kn(t,x)\} (6.362) 

Proof By the definition of the vector fields F^'^(t,x), we notice that for every 
(to,xo) e Z+ X di" , the solution of (6.355) with initial condition x(fo) — xq sat- 
isfies x(i + to) — F^'*(?o, ■'^o) for all / > 0. In order to prove that system (6.355) 
satisfies the dead-beat property of order n, it suffices to show that F^"' (t, x) = for 
all (t, x) e Z"*" X di'\ Using induction arguments, it is established that 

F<''(r+l,^(f,x)) =?('+" (r,x) and F'''(r,0):=0 forall/>0 (6.363) 

The proof of the above relations is easy and is left to the reader. Define the sets 
S'-'Ht) c di" for r e Z+ by the following formulas: 

S(°)(f):=9{" (6.364) 
S^'\t) := {x e S'-'-^\t):x„-i+i^kn-i(t,xi,...,Xn-i)} 

for 1 < / < « - 1 (6.365) 

S(')(0:={0} for/>n (6.366) 

where A:,- : 9{+ x di' -^ *){(/ = 1, . . . , n) are the functions involved in (6.347), (6.348). 
Notice that the definitions of the sets S^'Ht) above imply that, for 1 < ( < n — 1, 

5*''(r):= {xedi" : x„ = fc„_i(f,xi, . ..,x„_i), . . . , 

Xn-i+i =fc„-,(?,xi,...,x„_,)} (6.367) 

Next, we make the following claim. 

Claim F(')(f, x) e S'-'Ht + i) for all i > 0. 

Clearly, definitions (6.350) and (6.364) imply that the above claim is true for 
/ — 0. In order to prove the above claim, by virtue of definition (6.351), it suffices 
to prove the implication that F(t + i, x) e S''+^Ht + / + 1) if x e S''Ht + /). 

Since F(t,0) —0 for all r > 0, it follows that the above implication is true for 
i > n. For the case < / < n — 1, the above implication is an immediate conse- 
quence of (6.363) and properties (6.347), (6.348). 

Notice that the previous claim and definition (6.366) imply that 

F<"' (r, x) = for all (r , x) e Z+ x SH" (6.368) 

Thus, system (6.355) satisfies the dead-beat property of order n. 
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Let y > 1 and consider the function Vy : SH"*" x M" —^ iW"'" defined by (6.358). 
Since all vector fields F^''(r,x) (/ > 0) defined by (6.350), (6.351) and p are con- 
tinuous on J)i+ X ilt" with F<''(f, 0) = and p(0) = for all f > 0, by virtue of 
Lemma 2.3 in Chap. 2, there exist 02 e A'oo and j6 e K~^ such that the right-hand 
side inequality (6.359) holds. The left-hand side inequality (6.359) is an immedi- 
ate consequence of definitions (6.350), (6.358) and the fact that p(x) > K\x\ for 
all X e di" . Inequality (6.360) is an immediate consequence of definition (6.362). 
We next prove inequality (6.361). Notice that by virtue of definition (6.358) and 
property (6.363), we have, for all (t, x) e 2+ x di", 

n-l 

y^(f+l,F(f,x)) = ^y'p(F(')(r+l,F(f,x))) 

n — 1 n 



= ^yV(F('+i)(r,x)) = ^y'-V(F«(r,x)) 



i=0 ( = 1 

Consequently, from (6.368), definitions (6.356), (6.362), and the above equality it 
follows that 

'Py{t,X,k„it,X)) = Vy{t+1, Fit,X)) 

1 ""^ 1 ""' 1 

y i=i y (=0 y 

We conclude that inequality (6.361) holds. The proof of the fact that the function 
•^y (f , x,u) is quasi-convex with respect to m e di is identical to the proof of impli- 
cation (c) =► (a) of Proposition 6. 1 and is omitted. It follows from Proposition 2.3 in 
Chap. 2 that the closed-loop system (6.353) with u(t) — knit, ^(0) is RGAS. The 
proof is complete. D 

Proof of Theorem 6.7 Notice that for the case d — Q, it follows from (6.346) 
that system (4.56) has the triangular structure (6.354). Thus Lemma 6.8 holds, 
and (6.352) for d — Q and 1/y < A < 1 is a consequence of inequality (6.361). 
This proves that D{y, A) C D is a nonempty set with e D(y, X). The compact- 
ness of D(y, k) C. D follows from the compactness of D and continuity of all map- 
pings involved in (6.352) with respect to d. We next prove statement (ii). Let the 
Lyapunov function Vy : Z"*" x di" -^ di~^ be defined by (6.358) and notice that in- 
equality (6.352), in conjunction with definition (6.358), implies 

Vy{t+ I, f{t,d,x,kn(t,x)) <lVy(t,X) 
W(t, X, d)eZ+ X !H" x D(y, X) (6.369) 

From (6.359) and (6.369) in conjunction with Proposition 2.3 in Chap. 2 it follows 
that the closed-loop system (4.56) with u(t) — kn{t,x(t)) and d{t) e D(y,X) is 
RGAS. The proof is complete. D 
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Example 6.7.2 Consider the nonlinear planar autonomous system 

xiit + 1) = (1 + d{t)) |xi(r) I - xj(t) 

X2(t + 1) ^ X2(t) + u(t) 

(xiit), X2(t)) e m^, u{t) e m, d{t) eD:^ [-1, 1], t e Z+ (6.370) 
Notice that the dynamics of system (6.370) satisfy (6.356) with f\{t,x\,X2) 

1 



|xi| — x| and f2(t,x\,X2, u) :— X2 + u. Moreover, (6.347) and (6.348) are satis- 

1 9 i 

fied for ki(t,xi) :— \x1\2 and k2{t,xi, X2) :— —X2 + \\xi\ — jcj| 2 . Consequently, 



the vector fields F'-'1(t, x) are defined by (6.350), (6.351): 

F<°' (f , x) := (jci , X2)' F^^\t, x) := (|xi | - xj, \\xi\ - xj\^)' 

We select p(xi,X2) '.— \xi\ + \x2\. Thus, inequality (6.352) is equivalent to the fol- 
lowing inequality: 

\(l + d)\xi\-x^\ + ||xi|-x||2 

+ rWil + d)\xi\ - xj\ - \\xi\ - X2\\ 



+ y\\(l + d)\xi\ - xj\ -\\xi\-x?\\^ 



'2 1 
<X\xi\+X\x2\ + yl\\xi\ -X2| + kX||xi| -XjI^ (6.371) 



.21 , ,.,|,„ , 2|i 



Clearly, inequality (6.371) is satisfied for all (xi,X2) e di if ly > 1 and \d\ < 
niin{ 7x7 , ^ , — — T~^ } ■ Thus, we conclude that the closed-loop system (6.370) with 
u(t) — -X2it)+ ||xi(f)| -x|(r)|2 andfif(f) e D(y,X) for y = exp(c) -|- 1 and X = 
sxp(-c),ls.Jor d(t) e {d e [-1, 1]: \d\ < — ,-. ^ ' , , , ,,2 1> is RGAS. Notice that 

'^^ ' \ / I L ! J I I _ exp(2c)(exp(c)+l)2 " 

larger values for the constant c > (or equivalently, larger values for X) give smaller 
values for the radius of the disturbance set D(y,X). 



6.8 Small-Gain Method 

The purpose of this section is to briefly introduce the small-gain method arising 
from modern nonlinear control design for dynamical systems with strong nonlin- 
earities and intricate structures. Like previously presented synthesis methods, the 
small-gain control method is also an efficient tool for the explicit design of non- 
linear controllers. However, the small-gain method distinguishes itself from other 
constructive feedback design approaches in that it is motivated by robust nonlinear 
control design with dynamic uncertainties. When modeling a complex engineering 
system, those unmodeled dynamics such as friction in mechanical systems are often 
referred to as dynamic uncertainty. The state variables of the unmodeled dynam- 
ics are not perfectly measurable and therefore pose serious technical challenges for 
nonlinear control design. Other control problems also motivate us to consider the 
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presence of dynamic uncertainty. For example, even when the complete mathemat- 
ical model of a physical system is known, the controller design problem may be 
intractable either because the exact model has an intricate structure or because there 
is a large number of the states (measurable or not). To address these challenges, 
we purposefully decompose the model into a simplified and tractable control sub- 
system interacted with another subsystem which we will consider as the dynamic 
uncertainty. The advantage of this trick in nonlinear control design will be seen 
below, but it is important to stress that the small-gain method shares a design phi- 
losophy radically different from other constructive design approaches. Nonetheless, 
when combined with other methods such as backstepping, the small-gain methodol- 
ogy turns out to be powerful for robust adaptive output-feedback control design [23] 
and decentralized nonlinear control design [24, 27]. The reader should consult the 
literature for other extensions to control design problems for discrete-time systems, 
time-delay systems, and coupled differential-difference equations (see the review 
article [32] and references therein), to name only a few. 



6.8.1 What are Small-Gain Design Techniques? 

The nonlinear small-gain control method consists of two crucial results: 

• Gain assignment by feedback. 

• Nonlinear small-gain theorem for the stability analysis of the closed-loop system. 

Before describing the problem of gain assignment by feedback, let us recall the 
nonlinear, ISS small-gain theorem for an interconnection of two ISS subsystems 

x\^ f\{xi,X2,u\_) (6.372) 

X2^ f2{x\,X2,U2) (6.373) 

where xi e Dt"' and m,- e S)f"' for i — \,2. Assume that both /i and /2 are locally 
Lipschitz and vanish at the origin. See Fig. 1.2 for an illustration, where y\ — xi and 

It is shown in [28] that the interconnection of two ISS systems remains to be ISS, 
provided that the loop gain is less than the identity. More precisely: 

Theorem 6.8 Assume that each subsystem is ISS in the sense of Sontag, that is, 
there exist fii e KL and yt , y" C K with i — 1,2 such that the solutions of each 
Xi -subsystem satisfy 

\xi{t)\<lix{\xi(0)\,t) + Yi{\\x2i) + Yi{\\uxi) (6.374) 

|x2(0|</^2(|x2(0)|,r) + K2(l|xi||) + )/|(||M2ll) (6.375) 

where \\ ■ \\ denotes the Loo-norm. If there exist functions pi e A'oo, i — 1,2, such 
that one of the following two equivalent small-gain conditions holds: 
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{Id + pi) o yi o (W + P2) o K2 < Id, (6.376) 

{Id + P2) °Y2°i.Id+ pi)oYi< Id {6311) 

with Id standing for the identity mapping, then the total interconnected {x\,X2)- 
system is ISS, that is, the solutions {x\{t), X2{t)) satisfy: 

|(xi(r),x2(0)'|</S(|(xi(0),x2(0))'|,f) + y(||(Mi,M2)'||) (6.378) 

for some functions fi e KL and y e K. 

Remark 6.5 It is worth noting that a close-form expression for the (not necessarily 
unique) gain function y can be obtained on the basis of the functions y, , y" , and 
Pi, i — 1, 2. Also, as shown in [28], Theorem 6.8 can be extended to more gen- 
eral interconnected systems in the sense that one subsystem or both subsystems are 
input- to- state practically stable (ISpS), input-to-output stable (lOS), or even input- 
to-output practically stable (lOpS). The term "practical" is used to take into account 
the case when the unforced subsystems do not have an equilibrium (e.g., when non- 
vanishing disturbances occur). 

At first sight, ISS may look a restrictive stability requirement for nonlinear sys- 
tems. Surprisingly, Sontag [63] has shown that any nonlinear finite-dimensional sys- 
tem of the form k — f{x,u) can be made ISS by feedback (or feedback transforma- 
tion) if and only if it is stabilizable. A refinement of this important result shows that, 
for some special class of nonlinear systems, we may even assign somehow an arbi- 
trary gain for the derived ISS system. This result is referred to as gain assignment 
by feedback and plays a crucial role in nonlinear control design based on small-gain 
theorems. To illustrate this point, let us consider an interconnected system com- 
posed of an ISS subsystem with given gain y\ e Koo (which may not be small) and 
a controlled dynamical system which may not be ISS, as depicted in Fig. 6.1. 

The objective of the gain assignment result is twofold; first, apply a pre-feedback 
law a la Sontag [63] to render the non-ISS subsystem ISS. Then, redesign this con- 
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trol law to make the interconnection gain so small that the small-gain condition 
in (6.376) or (6.377) holds. For example, such a gain to be assigned to the non-ISS 
system can be ej/j" with < e < 1 . 

In the next subsection, we describe this strategy in greater details. It should be 
mentioned that it is a control design tool based on partial-state feedback. 



6.8.2 Gain Assignment via Feedback 

We begin with the robust stabilization of the following dynamically perturbed non- 
linear system: 

z^q{z,y) (6.379) 

y^u + wiz,y) (6.380) 

where z e £){"" is the (unmeasured) state of the dynamic uncertainty, y e J){ is the 
(measured) state of the controlled system, and u is the control input. Assume that 
the z-system (6.379) is ISS with a given gain yi e Koc- It is also assumed that q and 
cl) are locally Lipschitz and vanish at the origin and that the nonlinear perturbation 
Ci>(z, y) satisfies the following property: 

\co(z,y)\<M\z\)+M\y\) (6-381) 

for two smooth positive semidefinite functions (pi and 02- Without loss of generality, 
we may assume that (pi is of class Koo and 02(|y|) — \y\(p3(\y\) with a smooth 
function 4>3 ■ 

To design a globally stabilizing control law u — a(y) for system (6.379)-(6.380), 
we can apply the small-gain method as follows. First, pick a function y2 e K^o 
that, together with yi, satisfies the small-gain condition in (6.376) or (6.377). For 
simplicity, pick Yiis) — sy^ (s) for a constant £ in (0, 1). This way, the small- 
gain condition in (6.376) or (6.377) holds with linear pi and p2- Then, we design a 
partial-state feedback law u — a(y) that makes the j'-subsystem ISS with gain y2- 
After this is done, a direct application of Small-Gain Theorem 6.8 yields the global 
stability of the closed-loop system. 

The following gain assignment result shows when yx can be assigned as the ISS- 
gain for the y-subsystem by feedback. 

Theorem 6.9 There always exists a continuous feedback law u — a.{y) such that 
the closed-loop y-system is ISS with gain y2 when z is considered as the input. 
Moreover, if the following condition holds: 

01 ° Y2 (■*) '■^ linearly bounded near the origin (6.382) 

then, the feedback law u — a{y) can be made smooth. 

Proof Consider the Lyapunov function candidate V = ^y^. By direct computation, 
its time derivative satisfies 
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V — y[u + co(z, y)) 
<y{u + yM\y\)) + \y\M\^\) (6-383) 

Take the control law 

« = -yM\y\) - ^<P^ ° Y2^ {\y\) sgnW (6.384) 

for some constant ^ > 1 . 

From (6.383) and (6.384) it follows that 

V < -k\y\cl), o Y2\\y\) + Iyl0i(lzl) (6.385) 

which implies directly that the closed-loop y- system is ISS with gain yi- 

Clearly, the control law in (6.384) is continuous and can be made smooth under 
assumption (6.382). The proof is complete. D 

We borrow an example from the seminal work of Byrnes and Isidori [7] to illus- 
trate our result. Consider the control system 

z = -z^ + y"^ 

(6.386) 

y — u + z 

Clearly, (6.386) is a special member of the class of dynamically perturbed nonlinear 
systems (6.379)-(6.380). A direct application of Theorem 6.9 yields a continuous 
partial-state feedback of the form 

u^-k\y\^l^yy^ (6.387) 

for any constant k> \ that globally asymptotically stabilizes the system (6.386). As 
it can be directly checked, assumption (6.382) fails to hold. Thus, the control law 
(6.387) cannot be made smooth. In fact, Byrnes and Isidori have shown by means 
of the center manifold theory that there is no continuously differentiable control law 
of the form u — a{y) that even locally asymptotically stabilizes the system (6.386). 
To establish a gain assignment result for higher-dimensional systems, consider a 
chain of integrators subject to external inputs denoted as (d :— (ai , . . . ,(Dn)''- 

XI —X2 + (iL>i 

■ (6.388) 

Xn-l — Xn + 0)n-l 
Xn — U + &)„ 

The following gain assignment result is a special case of [28, Theorem 2.2]. 

Theorem 6.10 For any function y e K^q, if y~ is linearly bounded near the ori- 
gin, then there exists a feedback law of the form u — a{x) such that the closed-loop 
system (6.388) is ISS with respect to the input co and, in particular, lOS with the 
assigned gain y when y — x\ is taken as the output. 
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With Theorem 6. 10 at hand, the global stabilization problem by partial-state feed- 
back is easily solvable, via the proposed small-gain method, for 

xi — X2 + cii[(z,xi) 

: (6.389) 

X„-l =Xn + CL>n-l(z,Xi) 
Xn—U + Ci)„{z,Xi) 

where z is the unmeasured state of the dynamic uncertainty, x is the measured state 
of the controlled system, and u is the control input. 
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Consider the following discrete-time system: 

x{t + 1) = /(r, d{t), x{t), u{t)) 

x{t) e X, d{t) e D, u(t) eU,teZ+ (6.390) 

Y{t)^H{t,x{t)) Y(t)ey (6.391) 

under hypotheses (Ll-5). We consider the existence of a dynamic time-varying out- 
put feedback law w{t -|- 1) = g(t, y(t), w(t)), u{t) — k{t, y{t), w(t)), w(t) e W 
(Dynamic ROFS problem), where y(t) denotes the measured output given by 

y(t)^h{t,x{t)) y(t)ey (6.392) 

and y, W are normed linear spaces. We will further assume: 

(L6) For the output map h e CU{Z+ x X; y') involved in (6.392) with h{t, 0) = 
for all t eZ+, there exists a set 5 c y' such that S — h(t,X) for all t eZ+. 

We next give the notion of robust complete observability for discrete-time sys- 
tems. The definition given here directly extends the corresponding notions given in 
[15, 66], concerning autonomous continuous-time systems. 

Definition 6.5 Consider the system (6.390) and let (J,, «,) e D x U ,i — Q,\, ..., 
and define recursively the following family of continuous mappings: 

Fo(f,x) = x Fi(f,x,c;('\M('^) ^ f(t,do,x,uo) 

Fi {t, X, d^'Ku^'^) -.^ f{t + i- l,di-i, Fi-i (f , X, d'''-^\ M<'-^>), M,_i) / > 2 

yQ(t,x)^h{t,x) yi{t,x,d^'\u'^'^) -.^ h{t + i, Fi{t, x,d^'\u^'^)) i> 1 

where d^'^ :— (do, ■ ■ ■ , di-i), u^'^ :— (uq, . . . , m,_i) for / > 1. For an integer p >l, 
define the continuous mapping for all (t,x, d^''\ u^P^) e Di"*" x X x DP x U'^ by 

y^P^ (t, X, d^P\ u^P^) := (yoit, x),..., yp-i (t, x, d'-P'^K m*''-'')) 
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We say that a continuous function k e CU{Z~^ x X; W), where W is a normed 
linear space, is robustly completely observable from the output y — h(t, x) with re- 
spect to (6.390) if there exist an integer p >\ and a continuous function (called 
the reconstruction map) ^ e CU{Z+ x S x {y')P xl(P;W) such that, for all 
(t,x,d'^P\u'P^)eZ+ xXxDP X t/'', it holds that 

k{t + p,Fp{t,x,SP\u''P^)) 

= W{t + p, yp{t, X, d^P\ u'^P^), y'-P^t, X, d'^P\u^P^),u'-P^) (6.393) 

We say that system (6.390) is robustly completely observable from the output y — 
h{t, x) if the identity function k{t, x) = x is completely observable. 

Remark 6.6 

(a) Notice that for every input (d, u) e Md x Mu and for every (fo, xq) e Z"*" x X, 
the unique solution x(t) of (6.390) corresponding to {d, u) and initiated from 
xo at time ?o satisfies the following relation: for all t>tQ + p, 

k{t,x(t)) 

= 1'{t, y(t), y(t - p), y(t - p + I), . . . , y(t - 1), u(t -p),...,u(t- 1)) 

Following the terminology in [64], if system (6.390) is robustly completely ob- 
servable from the output y — h{t,x), then every control {d,u) e Md x Mu 
final-state distinguishes between any two events in time p e 2+ . 

(b) Notice that every continuous function of the measured output k{t,x) — 
6(t, h(t, x)), where 6 : Z"*" x S ^ W is a continuous function with the property 

"for every pair of bounded sets / C Z"*", A C. S and for every e > 0, the set 
6(1 X A) is bounded, and there exists 8 > such that \\9(t, y) — 9{t, yo)llw < s 
for all f e / and y, yo e A with \\y — yoWy < 5," 

is robustly completely observable from the measured output. 

(c) Notice that since e A" is an equilibrium point for (6.390) and h(t, 0) = for 
all ? > 0, by setting x = and u^P^ = in (6.393), we obtain 

/t(r,0) = t^(f,0,0) Vf>p. 

Without loss of generality, we may assume that the reconstruction map t^ is 
continuously extended to Z"*" x S x (y')P x UP so that the above equality holds for 
allr eZ+. 

The following proposition provides sufficient conditions for the solvability of the 
ROFS problem for (6.390), (6.391), (6.392). 

Proposition 6.3 Consider the ROFS problem for (6.390), (6.391) with measured 
output given by (6.392) under hypotheses (Ll-6). Suppose that: 

(i) There exists a continuous function k e CU(Z'^ x X; U) with f(t, d, 0, k(t, 0)) — 
for all (t, d) e Z"*" x D such that the closed-loop system (6.390), (6.391) with 
u(t)^k(t,x(t)) isRGAOS. 
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(ii) The feedback function k e CU{Z'^ x X; U) is robustly completely observable 
from the output y — h(t, x) with respect to (6.390). 

Then the continuous dynamic ROFS problem for (6.390), (6.391), (6.392) with 
measured output y — h{t,x) and stabilized output Y — H(t,x) is globally solv- 
able, i.e., there exist a normed linear space W and continuous functions k e 
CU(Z+ X SxW;U)andge CU{Z+ x SxW;W) with f(t, d, 0, k(t, 0, 0)) = 
and g{t, 0,0) — for all (t,d) € Z"*" x D such that the following system with state 
space X xW is RGAOS: 

x{t + 1) — f [t , d{t) , x{t) , k{t , h{t , x(t)) , w(t))) 

w(t + 1) = g{t,h{t,x(t)), w(t)) (6.394) 

Yit) = H{t,x(t)) 

Proof Since k e CU{Z~^ x X; U) is robustly completely observable from the output 
y — h{t, x) with respect to (6.390), there exist an integer p >1 and a reconstruction 
map ^ e CU(Z+ x Sx (yy x UP; U) such that for all {t, x, d^P\ u^p^) e Z+ x 
X X DP X UP (6.393), holds. Consider the following system: 

wi(f+l) = y(t) 

W2(t+ 1) = wiit) 



Wp(t+ 1) = Wp-lit) 

Wp+l{t+ 1) = u{t) 
Wp+2(t+ 1) = Wp+l(t) 



(6.395) 



W2p(t+ 1) = W2p-l(t) 

u(t) = ^{t,y(t),P{w(t))) 
Wiit) e y i^l,...,p 
Wiit) e U i — p+l,...,2p 

wit):^ (wiit), . . . , W2p(t)) e W :^ iy)P xUP teZ+ 



where 



Piw) := iwp, Wp-i, ...,wi, W2p, W2p-2, ■■■, Wp+i) (6.396) 

Clearly, for every ito,xo, wo,d) e Z+ x X x W x Mo, the solution of (6.390), 
(6.391), (6.392) with (6.395) and initial condition (x(ro), w(fo)) = ixo, wo) corre- 
sponding to input d e Mo satisfies, for all t >to + p, 

Wiit) — yit — i) i — I, . . . , p 

i6.391) 
Wp-\-i(t) — uit — i) i = I, ... , p 
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It follows from (6.397) and Remark 6.6(a) that 

u(t)^k{t,x(t))^<p{t,y(t),P{w(t))) St>to + p (6.398) 

Equality (6.398) shows that the implemented controIlawM(r) — ^{t, y(t), P(w{t))) 
coincides with the control action given by the state feedback law u(t) — k{t, x(t)) 
after p time units. By virtue of Theorem 2.1 in Chap. 2 and since the closed- 
loop system (6.390), (6.391) with u(t) = k{t,x{t)) is RGAOS, there exist func- 
tions a e KL and fi e K^ such that for all d e Md and {to, xq) e Z+ x A:", 
the unique solution x{t) of (6.390), (6.391) with u{t) — k(t,x(t)) initiated from 
xo e <¥ at time to e Z"*" and corresponding to d e Mo satisfies (2.8). It follows 
from (6.398) that for all d e Md all (t(),xo, wq) e Z'^ x X x W, the unique so- 
lution (x(t),wit)) of (6.390), (6.391), (6.392) with (6.395) and initial condition 
(x(fo), ui(to)) — (xQ, Wo) corresponding to input d e Mo satisfies 

\\H{t,X(t))\\y + ll(t)\\x(t)\\^ 

<(T{Pito + p)\\x(to + p)\\^,t -to- p) Vt>to + p (6.399) 

Notice that by virtue of Remark 6.6(c) and since f(t, d, 0, k{t, 0)) — for all 
{t,d) e Z"*" X D, we may conclude that e X x W is an equilibrium point for 
system (6.390), (6.391), (6.392) with (6.395). Moreover, by hypotheses (Ll-6) 
it follows that system (6.390), (6.391), (6.392) with (6.395) satisfies hypotheses 
(Ll-5) and consequently, by virtue of Lemmas 1.3, 1.4 in Chap. 1, and Lemma 2.7 
in Chap. 2, there exist functions fi e K~^ and a e Kqc such that for all d e Mo and 
ito,xo, wo)eZ+ X X X W, the unique solution x(0 of (6.390), (6.391), (6.392) 
with (6.395) initiated from (x(to), wito)) — (xo, wo) at time to>0 and correspond- 
ing to d e Mo satisfies 

||x(0||;t.+ ||w(0||iy <M(Ofl(lkollA' + lko||w) Vf>fo (6.400) 

Combining estimates (6.399) and (6.400), we conclude that the closed-loop sys- 
tem (6.390), (6.391), (6.392) with (6.395) satisfies the Robust Output Attractivity 
Property (Property P3 of Definition 2.2 in Chap. 2). By Lemma 2.1 the closed-loop 
system (6.390), (6.391), (6.392) with (6.395) is RGAOS. The proof is complete. D 

An immediate consequence of Proposition 6.3 is the following proposition, 
which provides a necessary and sufficient condition for the solvability of the dy- 
namic ROFS problem for (6.390), (6.391), (6.392). 

Proposition 6.4 (Separation principle) Consider the ROFS problem for (6.390), 
(6.391) with measured output given by (6.392) under hypotheses (Ll-6). The fol- 
lowing statements are equivalent: 

(a) There exist a normed linear space W' and continuous functions k e CU(Z'^ x 
X X W; U) and g e CU{Z+ xXxW; W) with f{t, d, 0, k(t, 0, 0)) = and 
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g(t, 0,0) — for all {t,d) e Z"*" x D such that the following system with state 
space X xW is RGAOS: 

x(t + 1) = f{t, d(t),x(t), k(t,x{t), w'it))) 

w'(t+l)^g{t,x{t),w'{t)) (6.401) 

y(?) = H(r,x(?)) 

Moreover, the functions k e CUiZ^ x A" x W'; U) and g e CU{Z^ x A" x 
W'\ W') are robustly completely observable from the output y' — (h{t,x), w') 
with respect to the system: 

x{t+ l)^ f(t,d{t),x(t),ui{t)) 

W'{t+ 1) = M2(0 

(x(0, w'{t)) eX xW', u(t) = {ui(t), M2(0) eU xW', d(t) eD,t e Z+. 

(6.402) 

(b) The continuous dynamic ROFS problem for (6.390), (6.391), (6.392) with mea- 
sured output y — h{t,x) and stabilized output Y — H{t,x) is globally solv- 
able, i.e., there exist a normed linear space W and coniirmous. functions k e 
CU(Z+ xSxW;U)andge CU{Z+ xSxW;W) with f{t,d,0,k(t,0,0))^ 
and g{t, 0,0) — Ofor all {t, d) e Z"*" x D such that system (6.394) with state 
space X xW is RGAOS. 

Implication (a) =► (b) of Proposition 6.4 is an immediate application of Proposi- 
tion 6.3 to the control system (6.402) with input (mi, U2). Implication (b) =► (a) 
of Proposition 6.4 is an immediate consequence of Remark 6.6(b). We remark 
that since the component x{t) of the solution of (6.402) does not depend on 
the input U2, the requirement that the functions k e CU{Z~^ x X x W'; U) and 
g e CUiZ'^ X X X W'\ W') are robustly completely observable from the out- 
put y' — (hit, x), w') with respect to the system (6.402) implies the requirement 
that, for every w' e W', the functions (f,x) e Z"*" x X ^ k(t,x, w') e U and 
(t, x) e Z"*" X X —>■ g(t, X, w') e W' are robustly completely observable from the 
output y = h(t, x) with respect to the system (6.390), (6.391), (6.392). 

Example 6.9.1 Consider the ROFS problem for the system 

Xl(t + \) ^ X2{t) 

X2(t + \) ^ xlit) + u(t) 
XT,(t + 1) — d(t)x3it) + exp(f)x2(r) 
Y(t)^x(t) 
X := (xi, X2, X3) e SW^ u(t) edi,te Z+, dit) e [-r, r] (6.403) 



where r e [0, 1), with measured output y — xi. First notice that the feedback func 

^2 



tion k(t,x) :— — x? stabilizes system (6.403). We prove this claim by considering 
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the Lyapunov function V{t, x) :— \xi \ + 3exp(f)|x2| + \xi,\, which clearly satisfies 
the following inequalities: 

\Y\^\x\<V(t,x)<5exp(t)\x\ V(f,x) e Z+ x S1{^ (6.404) 

V[t + 1, j«:2,X2 + k{t,x), dx^ + exp(t)x2) 
<(l + exp(0)|x2|+r|x3| 

.™x|?,.jv,„, V,,,,..,eZ-. .'.[-..] ,6^405, 

and since max{|, r} < 1, by virtue of Proposition 2.3 in Chap. 2, we conclude that 
the closed-loop system (6.403) with u(t) — k{t,x{t)) is RGAOS. Moreover, the 
feedback function k{t, x) :— — x| is robustly completely observable from the output 
y — xi. Particularly, we define the continuous mappings (following the notation of 
Definition 6.5) 

(X2 
xj + uo 
dox-i -|-exp(0x2, 

yoit , x) — x\ , yi{t , X , d^ \u '\ :— X2 

Clearly, we have 

k{t + 1, Fi{t, X, d^^\ «(!')) = ^{t + 1, yuyo, Mo) := -(y? + "o)^ 
Consequently, the closed-loop system (6.403) with 

w(t + 1) — u(t) 
u{t)^-{y^{t) + w{t)f 
w(t) em,te Z+ 
is RGAOS. 



6.10 Bibliographical and Historical Notes 

1. A vast number of papers and books is devoted to the stabilization of linear 
systems described by ODEs. The reader can use the reference list included in 
[64], where many papers and books on linear system theory are cited. For time- 
delay linear systems, one can consult [51]. 

2. The goal of solving the Robust Output Feedback Stabilization problem for non- 
linear systems is highly nontrivial. The issue of robustness to modeling and 
actuator errors and measurement noise makes the problem harder. There are 
classes of nonlinear systems described by ODEs for which stabilizing feedback 
laws can be designed which also take into account actuator errors and measure- 
ment noise, e.g., triangular globally Lipschitz systems. For infinite-dimensional 
systems, the Robust Output Feedback Stabilization problem is currently under 
intensive research. 
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3. Sampled-data globally stabilizing feedback laws for homogeneous systems 
were proposed in [16]. 

4. Clearly, a necessary condition for the existence of a stabilizing state feedback 
law is asymptotic controllability (see [64]). However, there are systems which 
are asymptotically controllable and cannot be stabilized by a continuous state 
feedback law, e.g., Artstein's cycles (see, e.g., [5, 64]). The existence of a Con- 
trol Lyapunov Function under the assumption of asymptotic controllability is 
studied in [1, 59, 64] (see also references therein). The existence of feedback 
stabilizers under the assumption under the assumption of asymptotic controlla- 
bility is studied in [9, 16, 65]. 

5. The design of stabilizing feedback laws by means of the Artstein-Sontag ap- 
proach for nonaffine control systems described by ODEs was recently studied 
in [33, 47]. Recently, the Artstein-Sontag approach was extended in [39], so 
that it can be applied under weaker hypotheses. 

6. A comparison between the Artstein-Sontag approach and the Coron-Rosier 
approach is provided next. 

• the Artstein-Sontag methodology allows the use of Lipschitz RCLFs, while 
the Coron-Rosier methodology requires continuously differentiable RCLFs; 
this is exactly the reason why the Artstein-Sontag approach can be extended 
to infinite-dimensional systems while the Coron-Rosier approach faces im- 
portant difficulties with infinite-dimensional systems, 

• the Artstein-Sontag approach can provide explicit formulas for stabilizing 
feedback laws (see [36, 62]), while the Coron-Rosier approach leads mostly 
to existential results, 

• the Artstein-Sontag methodology can provide time-independent feedback 
laws while the Coron-Rosier methodology always gives time-varying feed- 
back laws, 

• the Coron-Rosier approach does not require convexity assumptions; on the 
other hand, the Artstein-Sontag approach requires that the control set is con- 
vex and demands additional properties for the RCLF. 

7. Backstepping, also called "adding an integrator" by European authors initially, 
is a powerful method to recursively design adaptive and nonlinear controllers 
for systems with a cascade structure or taking the strict-feedback form. As 
stated in [41], the origin of this idea can be traced back at least to the year 
1989 when several related schemes were presented by different authors. See the 
excellent monograph [41] for the details. Also see [1 1, 13, 19, 26, 30, 34, 40, 44, 
60, 69] for other recent extensions. Special results, which guarantee additional 
properties for the constructed feedback (e.g., linearity), are given in [45, 68, 
70]. The backstepping-based result provided in Sect. 6.7 for systems described 
by RFDEs appeared in [33], and the backstepping-based result in Sect. 6.7 for 
discrete-time systems appeared in [34]. 

8. Another method of proving stability that can be used for feedback design is 
the use of Matrosov functions (see [43]). However, this approach is not studied 
here. 
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9. In many cases, the existence of a control Lyapunov function can lead to practical 
and/or semiglobal stabilization: see [48, 49, 66]. 

10. The small-gain method for nonlinear feedback design was introduced in [28] for 
important classes of dynamically perturbed nonlinear systems. It was quickly 
generalized to nonlinear systems with (linear) input unmodeled dynamics 
[42] and (nonlinear) input dynamic uncertainties [25]. Other interesting ex- 
tensions for nonlinear decentralized systems, time-delay systems, and coupled 
differential-difference equations can be found in [24, 32] and references therein. 

11. The Output Feedback stabilization problem and the corresponding observer de- 
sign problems for continuous-time systems have been studied by many authors 
(see [6, 14, 35, 53-58, 71]). The separation principle holds for linear systems 
described by ODEs. Recent results in [3, 8] have provided the extension of 
the separation principle for nonlinear systems described by ODEs. The output 
feedback stabilization results for discrete-time systems contained in the present 
work first appeared in [31]. 
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Chapter 7 
Applications 



7.1 Introduction 

This chapter aimed to demonstrate the wide applicability of the analysis and syn- 
thesis tools presented in previous chapters. While there are many good control en- 
gineering applications we may choose, a tough decision must be made for want of 
space. We depart from practical application examples commonly adopted by con- 
trol engineers and researchers, and will study three nonconventional, but challenging 
and important, case studies from three different areas: mathematical biology, numer- 
ical analysis, and mathematical economics. These emerging applications are driving 
forces behind our search for new tools for nonlinear systems and control. The chap- 
ter objective is to present novel solutions to the feedback stabilization problem by 
means of the tools presented in previous chapters. 

In the following, we describe in details these interesting control problems: 

• The stabilization of a delayed chemostat model (Sect. 7.2). The application shows 
how the small-gain results of Chap. 5 can be applied for the robust stabilization 
of uncertain systems with delays. Moreover, the application illustrates the poten- 
tial of the use of novel small-gain results to difficult problems in Mathematical 
Biology and process control engineering. 

• The stabilization of numerical schemes for the numerical solution of systems 
described by ODEs (Sect. 7.3). This application shows how feedback stabiliza- 
tion methodologies can be used for the solution of classical problems in areas of 
applied mathematics different from mathematical control theory. A well-known 
problem in numerical analysis is converted to an abstract feedback stabilization 
problem and is solved by applying modern nonlinear feedback design method- 
ologies. 

• The stabilization of the price of a commodity by manipulation of buffer stocks 
(Sect. 7.4). The application shows the efficiency of the proposed feedback stabi- 
lization methodologies for the solution of problems in mathematical economics. 
The application also shows how government policies may be driven by nonlin- 
ear mathematical control theory (hence the term "cybernetics" was coined by the 
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mathematician N. Wiener from the greek word KvPepvci) — govern, to refer to 
control theory and related areas). 

It is clear that the list of potential applications of modern nonlinear control theory 
in general, and the presented stability and stabilization results in particular, is long. 
We would partially achieve our objective of writing this monograph if the reader 
were inspired by the contents of the present chapter and were ready to tackle even 
more challenging stabilization problems. 



7.2 Stabilization of a Delayed Chemostat Model 

The small-gain results presented in this book can allow a transient period during 
which the solutions do not satisfy the lOS inequalities (Theorems 5.1 and 5.2 in 
Chap. 5). Here, we show how the obtained small-gain results can be used for the 
feedback stabilization of uncertain chemostat models (see also [4] for applications 
of small-gain results to biological systems). 

More specifically, we consider the robust global feedback stabilization problem 
for the chemostat model with delays (1.13), where b >0 is the cell mortality rate, 
r > is the maximum delay, and ^(i') > is a possibly variable yield coefficient. 
The functions /x : [0, sin] —>■ [0, yUmax] with /Li(0) — and /x(i) > for all i' > 
and K : [0, Si„] —>■ (0, +oo) are assumed to be locally Lipschitz functions. It should 
be noted that the case of variable yield coefficients has been studied recently (see 
[34, 35]) and has been proposed for the justification of experimental results. The 
reader should notice that chemostat models with time delays were considered in 
[32, 33]. By assuming the existence of a nontrivial equilibrium point for (1.13), i.e., 
the existence of (Z*, 5*, D*) e (0, +oo) x (0, ^in) x (0, +oo) such that (1.14) holds, 
and using the change of coordinates and input transformation (1.15) we obtain the 
equivalent transformed system (1.16). 

The stabilization problem for the equilibrium point (X*, s*, D*) e (0, +oo) x 
(0, .Jin) X (0, +oo) is crucial: in [30] it is shown that the equilibrium point is unstable 
even if fj, : (0, Sin) —)' (0, /Xmax] is strictly monotone (e.g., the Monod specific growth 
rate). Moreover, as remarked in [30], the chemostat model (1.1 1) under (1.12) allows 
the expression of the effect of the time difference between consumption of nutrient 
and growth of the cells (see the discussion on pp. 238-240 in [30]). 

Here, we solve the feedback stabilization problem for the chemostat by providing 
a delay-free feedback which achieves global stabilization (see Theorem 7.1 below). 
The proof of the theorem relies on the small-gain results of the book. No knowledge 
of the maximum delay r > is assumed. The stabilization is "global": here the 
adjective "global" refers only to "admissible states," i.e., for all initial conditions 
(Zo, ^o(-)) e (0, +c^) X C°a-r, 0]; (0, .;„)). 

In order to solve the robust feedback stabilization problem for the chemostat 
model (1.16), we will assume that 

(H) There exists Sp e (0, s*) such that (j.(s) > b for all s e [sp, sia]. 
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Hypothesis (H) is automatically satisfied for the case of a monotone specific 
growth rate. Hypothesis (H) can be satisfied for nonmonotone specific growth rates 
(e.g., Haldane or generalized Haldane growth expressions). By using the trajectory- 
based small-gain Theorem 5.2, we can prove the following theorem. 

Theorem 7.1 Let a > be a constant that satisfies 

s* 
min fi(s) — b > aD* — (7.1) 

.Sp<.S<.Si„ S[ji 

Then, the locally Lipschitz delay-free feedback law given by 

^ K(s(t))iiisit))X{t) + aD*{s* - min(^(f). s*)) 
Sin — mir\{s(t),s*) 

achieves the robust global stabilization of the equilibrium point {X*,s{-)) e 
(0, -hoc) X C'^ii-r, 0]; (0, ^in)) with s(0) = s* for all e [-r, 0], for the uncer- 
tain chemostat model (1.13) under hypothesis (H). 

In the new coordinates (see (1.15)), the feedback law (7.2) takes the form 

u{t) = ln( g(x2(r))exp(j[:i(f))min(G + exp(x2(r)), G + l) 

+ ^^ max(l - exp(x2(r)), 0)") (7.3) 

The feedback law (7.3), or (7.2), is a delay-free feedback, which achieves global 
stabilization of e i)J x C^{[—r, 0]; 9J) for system (1.16) no matter how large the 
delay is. Furthermore, no knowledge of the maximum delay r > is needed for 
the implementation of (7.3). As a result, the proof of Theorem 7.1 is equivalent 
to the proof of robust global asymptotic stability of the equilibrium point e S)t x 
C°([-r, 0]; 9t) for system (1.16). 

Before we give the proof of Theorem 7.1, it is important to understand the intu- 
ition that leads to the construction of the feedback law (7.3) and the ideas behind 
the proof of Theorem 7.1. To explain the procedure, we follow the following argu- 
ments: 

1. For the stabilization of the equilibrium point e J)i x C°([— r, 0]; 9i), we first 
start with the stabilization of the subsystem 

i2(0 = £)*(Gexp(-X2(0) + l) 

X (exp(M(r)) - (G + exp(x2(f)))g(x2(0) exp(xi(r))) 

with xi as the disturbance input and u as the control input. Any feedback law 
which satisfies u{t) — ln(g(x2(f))exp(xi(f))(G + 1)) for X2(f) > and u{t) > 
ln(g(x2(t)) exp(xi (?))(G + exp(x2(f )))) for X2(0 < achieves ISS stabilization 
of the subsystem with xi as the input. 

2. In order to prove URGAS for the composite system by means of small-gain 
arguments, one has to show the ISS property of the xi -subsystem xi(f) — 
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min,_,.<r<r AfeC^)) + d(t){maxt-r<r<t P-ixiM) - min,_r<T<, /i(x2(r))) - 
D* exp(M(f )) — b with X2 as the input. Notice that the feedback selection from the 
previous step gives xi(r) — min,_,.<r<r A(-'f2(T)) + <j?(?)(max,_,-<r<r /l(x2(r)) — 
mm,-i-<T<t Afe(r))) - Z)*g(x2(r))exp(xi(r))(G + 1) - b for X2{t) > and 
ii(0 <inin,_r<T<f /i(x2(r))- D*g(x2(0)exp(xi(0)(G + exp(x2(r))) - b for 
xiit) < 0. The estimation of the derivative xi{t) shows that the ISS inequality 
for the xi-subsystem does not hold unless we have min,_,<T<, il(x2(r)) > b for 
all t sufficiently large. By virtue of hypothesis (H), there exists y < such that 
the ISS inequality for the the xi -subsystem holds if min/_^<T<,X2(r) > y for all 
t sufficiently large. 
3. The feedback law u{t) > ln(g(x2(0)exp(xi(f))(G + exp(x2(0))) for X2(?) < 
is selected such that the inequality min,_,<T<, X2(t) > y holds for all initial 
conditions after a transient period. Since the ISS inequalities will hold only after 
this transient period, the trajectory-based small-gain result Theorem 5.2 must be 
used for the proof of URGAS of the closed-loop system. 

Proof of Theorem 7.1 Consider the solution (xi (f), .^2(0) ^ '^^ of (1.16) with (7.3) 
with arbitrary initial condition x\ (0) e S)t, 7]- (0)x2 e C°([— r, 0]; W) and correspond- 
ing to arbitrary input d e M/j. The following equations hold for system (1.16) 
with (7.3): 

. Gexp(— X2(?)) + 1 , / x\ 

i2(0 = aD* ^' \" (1 - exp(x2(f))) if X2(0 < 

G + 1 

i2(0 = £>*g(x2(f))(Gexp(-X2(f)) + l)exp(xi(0) ^'^ '^^ 

X (l-exp(x2(0)) ifx2(r)>0 

Equations (7.4) imply that the function y(f) — x|(f) is nonincreasing, and conse- 
quently, we obtain 

|^2(0|<||7>(0)x2||^ for all f e [0, Wx) (7.5) 

Using the fact that [i : (0, Sin) -^ (0, /Xmax] and definition (1.17) of /i, we get that 
A(^2) < Mmax for all X2 e di. This implies the following differential inequality: 

XI (r) < 2/Xmax - b 

which by direct integration yields the estimate 

XI (f) < XI (0) + (2/Ltniax - b)t for all t e [0, Wx) (7.6) 

Define k:{s) := (G + l)D* max\y\<s g{y)- Inequalities (7.5) and (7.6) imply that the 
following differential inequality holds: 

hit) >-b- ^— - ^(||r,(0)x2||Jexp(xi(0) + (2/Xn,ax - b)t) 
which by direct integration yields the following estimate for all t e [0, ?max): 
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aD* 

xiit)>xi(0) 



G+1, 

l\\ -r m\ II \ I m\\ exp((2/Xmax - b)t) - 1 

-/(:(||7;.(0)x2||Jexp(xi(0)) (7.7) 

Inequalities (7.5), (7.6), and (7.7) and a standard contradiction argument show that 
system (1.16) with (7.3) is forward complete, i.e., fmax — +oo. Therefore, inequal- 
ities (7.5), (7.6), and (7.7) hold for all t >0, and since system (1.16) with (7.3) is 
autonomous, it follows that system (1.16) with (7.3) is Robustly Forward Complete. 
Define W{t) — xjit) if X2(t) < and W(t) = if otherwise. Using (7.4), we 
obtain the existence of a positive definite function p e C*'(9i"'"; Di"*") such that 

Wit)<-p{W(t)) forallr>0 (7.8) 

Lemma 2.13 in Chap. 2 implies the existence of ct e KL such that, for all xi (0) edi, 
TriO)x2 e C°{[-r, 0]; M), and d e Md, it holds that 

W{t)<a(W{Q),t) forallf>0 (7.9) 

Inequality (7.9), in conjunction with Theorem 3.1 in Chap. 3, shows the existence 
offl e ^00 such that for all XI (0) e SW, r,(0)x2 e C^{[-r,Q]; 9J), andrf e Mq, there 
exists ^ >r with f < r + fl(|x2(0)|) satisfying 

X2(t-r)>-- forallr>^ (7.10) 

where c := ln( '° J' ) > 0, and Sp < s* is the constant involved in hypothe- 
sis (H). Define 5 := Dt x C°([-r,0]; [-c/2, +oo)). Inequality (7.10) shows that 
{xi(t), Tr(t)x2) e S for all f > § and that inequality (5.16) holds for appropriate 
a e Koo and c(t) = 1. 

Notice that for (xi(t), Tr(t)x2) e S, the functionals 

Vi(t)^ max exp(2ae)\z(t + 0)\^ V2^\xi(t)f' (7.11) 

9e[-r,Q] ' ' ' ' 

where cr > and 

X2(0 = c(exp(z(?))-1) (7.12) 

are well defined. Moreover, by considering the differential equations 

v.^ „*Gexp(c(l-exp(z(f))))+l ., . . ... 

z(t)^aD* ^ exp(-z(r))(l-exp(c(exp(z(f))- 1))) 

ifz(O<0 
z(0 = c-iD*g(c(exp(z(r)) - l))(Gexp(c(l - exp(z(r)))) + l)exp(xi(0 - z(0) 
X (1 - exp(c(exp(z(f)) - l))) if z(r) > 0, 

we conclude from Lemma 2. 14 in Chap. 2 and Lemma 6.7 in Chap. 6 that, for every 
yi,2 e Koo, there exists cti e KL such that 

yi(0<max|ai(Vi(fo),f-ro), sup Ki,2(V2(r))l for all f > fo > (7.13) 

' to<T<t ' 
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Finally, using hypothesis (H) and definitions (7. 11), we guarantee that there exists a 
positive definite function p e C°(S1{"'"; Sit"*") such that the following holds for every 
e>0: 

"Whenever 

,, , ,, / (G + exp(c(exp(7y^)-l)))Z)»max,.|^yv,^g(c(exp(z)-l)) 

(1 + e) In '"'-^ "^ ; 

\^^\j<exp(ar)^/W(r) i^(''i^'^P(i'> - 1)) - ^ - ^D*{1 - exp(c(exp(- V Vi (f)) - 1))) 

< 1-^1 (0|, 

^ ^ ^^/ max|,|<^^p(^^)yy^/2(c(exp(z) - I)) - b \ 

"\(G + exp(c(exp(-Vyr(f))-l)))Z)*min|,|<yj7^g(c(exp(z)-l))/ 

< 1-^1 (0 1 

then 2xi{t)xi(t) < -p(x^(r))." 

Therefore, Lemma 2.14 in Chap. 2 implies that there exists 02 e KL such that 

V2it)<max\a2{V2(tQ),t-to), sup y2,i(V'i(T))| for all f > fo > (7.14) 

where 

ViAis) := (1 +e)2(ln(max{gi(^),g2(^)}))' 

(G + exp(c(exp(V^) - 1)))D* maX|^|<^ g(c(exp(z) - 1)) 



82(s) 



™n|,|<exp(o-r)v^M(c(exp(z) - 1)) - fo - g^(l - exp(c(exp(-Vs) - 1))) 
_ max|,|<g^p(„^)^/i(c(exp(z) - 1)) - b 

(G + exp(c(exp(-V^) - l)))£)*min|,|<^g(c(exp(z) - 1)) 

(7.15) 



Inequalities (7.5), (7.6), (7.7), (7.13), and (7.14) guarantee that inequali- 
ties (5.10), (5.11), (5.13), (5.14), (5.15), and (5.17) hold for appropriate a e KL, 
ve K+, andfl e Koo with c(r) = \, p = 0, y\,2{s) :=y2,i(f), YiAs) ^ Y2,2{s) = 

0, L ;= Vi + V2, and H{t, xi, X2) := J xl + ||x2||^. Finally, notice that the MAX- 

preserving mapping F : S){^ — >• Dt^ with /l(x) — maxy=i_2 Yijixj) (i — 1, 2) satis- 
fies the cyclic small-gain conditions. 

By virtue of Theorem 5.2, we conclude that the autonomous system (1.16) 
with (7.3) is URGAS. D 



7.3 Applications to Numerical Analysis 

It is well known that step size control can enhance the performance of a numeri- 
cal scheme when applied to a system of Ordinary Differential Equations (ODEs). 
In fact the use of the word "control" suggests that methods and techniques used in 
Mathematical Control Theory can be (in principle) used in order to achieve cer- 
tain objectives for the numerical solution of systems of ODEs. For example, in 
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[10] the authors use a "Proportional-Integral" technique which is similar to the 
"Proportional-Integral" controller used in Linear Control Theory in order to keep 
the local discretization error within certain bounds (see also [8, 9, 12]). Theoretical 
results on the behavior of adaptive time-stepping methods have been presented in 
[22, 24], and the control theoretic notion of input- to- state stability (ISS) has been 
successfully used in [6, 7] in order to explain the behavior of attractors under dis- 
cretization. 

In this section, we consider the problem of selecting the step size for numerical 
schemes so that the numerical solution presents the same qualitative behavior as the 
original system of ODEs. It is well known that any consistent and stable numeri- 
cal scheme for ODEs inherits the asymptotic stability of the original equation in a 
practical sense, even for more general attractors than equilibria; see, for instance, [6, 
7] and [31] (Chap. 7). Practical asymptotic stability means that the system exhibits 
an asymptotically stable set close to the original attractor, i.e., in our case a small 
neighborhood around the equilibrium point, which shrinks down to the attractor as 
the time step h tends to 0. In contrast to these results, here we investigate the case in 
which the numerical approximation is asymptotically stable in the usual sense, i.e., 
not only practically. 

We focus on nonlinear systems for which an equilibrium point is the global at- 
tractor. First, we show how the problem of appropriate step size selection can be 
converted to a rigorous abstract feedback stabilization problem for a particular hy- 
brid system; see also [16] — the reader should notice that the standard stability anal- 
ysis of numerical schemes uses the study of a discrete-time system, e.g., [11, 13, 15, 
23, 31], not a hybrid system. Therefore, we are in a position to use all methods of 
feedback design for nonlinear systems. Secondly, we apply small-gain methods for 
the solution of the problem for a class of nonlinear systems. 



7.3.1 Conversion to a Feedback Stabilization Problem 

Consider the autonomous dynamical system 

z(0 = /(z(0) ziDedl" (7.16) 

where f :di" ^ M" is a locally Lipschitz vector field with /(O) — 0. For all zo e di" 
and f > 0, the solution of (7.16) with initial condition z(0) — zo will be denoted by 
z(t, 0, Zo), or z(t, Zo) or simply z(t) if there is no confusion from the context. The 
numerical approximation of system (7.16) will be the following system with variable 
sampling partition: 

i(f) = F{hi,x{xi)) t e [ti, r;+i) 

To = 0, r,+i — tj + hi 
hi = (p{x(ri)) exp(-M(r,)) 

x(OeSH", M(f)e[0,+oo) (7.17) 
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where ip e C''(S)t"; (0, r]), r > is a constant, and F : U\:e'ii"([0, (p(x)] x [x]) -^ 
S)f' is a (not necessarily continuous) vector field with F(h,0) — for all h e 
[0, ^(0)] and lim;,^o+ F(h^ z) — f(z) for all z e di" . Modelling numerical approx- 
imations by hybrid systems instead of the usual discrete-time system enables us to 
simultaneously investigate the qualitative behavior for all time steps h e (0, (p(x)] 
simultaneously. 

We assume that there exists a continuous nondecreasing function M : di~^ -^ Dt"*" 
such that 

\F(h,x)\<\x\M{\x\) forallxeDrand/!e[0,(/)(x)] (7.18) 

It should be noticed that the hybrid system (7.17) under hypothesis (7.18) is an 
autonomous system with variable sampling partition. Some remarks are needed in 
order to justify the name "numerical approximation of system (7.16)" for the hybrid 

system (7.17): 

1. Notice that the condition lim/,^o+ F{h, z) — f(z) is a consistency condition for 
the numerical scheme applied to (7.16). 

2. The sequence {h,}^ is the sequence of step sizes used in order to obtain the nu- 
merical solution. Notice that for the case q){x) = r, constant inputs u(t) = u>0 
will produce constant step sizes with hi = r exp(— m). Moreover, notice that vari- 
able step sizes can be represented easily by selecting in an appropriate way the 
input m:!){+^!){+. 

3. The constant r > is the maximum allowable step size. 

4. The function (p e C°(S1{"; (0, r]) determines the maximum allowable step size 
(p{x{ri)) for each x(r,) e di'\ This is important for implicit numerical schemes 
as shown below. 

All consistent s -stage Runge-Kutta methods can be represented by the hybrid 
system (7.17). More specifically, let xq e di" and consider a consistent i'-stage 
Runge-Kutta method for (7.16), 

s 

Yi^xo + hJ^aijfiYj) i^l,...,s (7.19) 

./=i 

S 

x^xo + hJ^bifiYi) (7.20) 

/=i 

with ^/_] bi — 1. If the scheme is explicit, i.e., if aij — for j > i, then there 
always exists a unique solution to (7.19). If the scheme is implicit, then in order 
to be able to guarantee that (7.19) admit a unique solution, it may be necessary to 
restrict the step size to h e [0, (p{xo)] for some maximal step size (p{xo) depending 
on the state xq e di" . 

A suitable choice for (p{x) may be obtained in the following way. Let y : Ot"*" — ^ 
Dt"*" be a continuous nondecreasing function with |/(x)| < |x|y(|x|) for all x e Dt" 
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(such a function always exists since / : !){" -^ di" is a locally Lipschitz vector field 
with /(O) — 0). Let L^ : dV -^ (0, +oo) be a continuous function satisfying 

\fM-f(y)\ 



Lxixo)>sup 



:x,yeBx(xo),Xy^y 



\x-y\ 

for all XQ e 0)r\{0}), with B^ixo) := {x e m" : \x - xq] < X\xq\}, k e (0, 1). The 
continuous function (p(x) := \A\(U(x]+y(\x\)) ' where \A\ := max/=i,...,i ^] [aijl, 
guarantees that for all xq e di" and h e [0, (p(xo)] equations (7.19) have a unique 
solution satisfying Y, e Bx(xo), i — 1, .. . ,s. Note however that this bound may 
be conservative. For instance, if we apply the implicit Euler scheme (i = 1, an — 
/jj = 1) to an asymptotically stable linear ODE of the form x — Jx with a Hurwitz 
matrix J e d\"^", then (7.19) becomes 

Yi^xo + hJYi ^ {I-hJ)Yi^xo 

which always has a unique solution because all eigenvalues of — 7 and thus of / — 
hJ have positive real parts for all h >0; hence, I — hJ is invertible for all h >0. 
We define 

s 
F{h,xo):^h-\x-xo)^Y,bif{Yi) (7.21) 

(=1 

A moment's thought reveals that for every locally bounded u : di~^ -^ d\~^ and for 
every xq e di", the solution of (7.17) with (7.21) coincides at each r,, / > 0, with 
the numerical solution of (7.16) with x(0) — xq obtained by using the Runge- 
Kutta numerical scheme (7.19), (7.20) and using the discretization step sizes hj — 
^(x(T,))exp(— m(t,)), i > 0. The reader should notice that other ways (besides 
(7.21)) of defining the vector field F : Uve'ii" (t^' Vix)] x {x}) -^ di" may be possi- 
ble; here we have selected the simplest way of obtaining a piecewise linear numeri- 
cal solution. 

Moreover, the reader should notice that appropriate step size restriction can al- 
ways guarantee that (7.18) holds for F : Ute'i!"([0' fix)] x {x}) —>■ i)i" as defined 
by (7.21). For example, if <pix) :— ukl <x)+ (\xm ^^ ^^^ ^'■^P ^^^^ restriction de- 
scribed above, then F : Ute'ii"([0' ^(■^)] ^ f-^}) ~^ ^^" ^^ defined by (7.21) sat- 
isfies \Fih,x)\ < \x\[l + r(l + ;^)(E/=i I^I)k((1 + ^)kl)] for all x e m" and 
h e [0, (pix)]. Thus, (7.18) holds with M{y) := l + r(l + k)iJ2'^y \bi\)yi{l+k)y). 

Assume next that e !){" is Uniformly Globally Asymptotically Stable (UGAS) 
for (7.16). Our goal is to be able to produce numerical solutions using the numerical 
approximation (7.17) which have the correct qualitative behavior. More specifically, 
we would like to be in a position to know a continuous function ip : i)i" -^ (0, r] 
such that the numerical solution produced by (7.17) has a correct qualitative be- 
havior (e.g., limr^-|_oox(f) — 0). However, we would like to be able to guarantee 
that a correct behavior for the numerical solution can be obtained by using arbitrary 
discretization step sizes smaller than ip{x(ri)) (i.e., if we obtain the correct quali- 
tative behavior using the discretization step sizes hj — ip(x(r/)), i > 0, we would 
like to obtain a correct qualitative behavior using the smaller discretization step 
sizes hi — (p(x(ri)) exp(— M(r,)), / > 0, where u : di~^ —>■ M"'" is an arbitrary locally 
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bounded function). This is equivalent to requiring that e f){" is Uniformly Robustly 
Globally Asymptotically Stable (URGAS) for (7.17). 

The reader should notice that continuity for the function cp : S)t" —>■ (0, r] is essen- 
tial: without assuming continuity, it may happen that liminfv^o <p(x) = 0, and this 
would require discretization step sizes of vanishing magnitude as f ^^ +oo. More- 
over, since we want to be able to determine a continuous function cp : SH" -^ (0, r] 
which "stabilizes" the hybrid system (7.17), we are essentially studying a feedback 
stabilization problem for the hybrid system (7.17). Hence, we are in a position to 
pose the problem rigorously. We consider the following feedback stabilization prob- 
lems: 

(PI) Existence Problem Is there a continuous function ^ : J){" — )► (0, r] such that 

e m" is URGAS for system (7.17)? 
(P2) Design Problem Construct, if possible, a continuous function q) : J){" —>■ (0, r] 

such that e Dt" is URGAS for system (7.17). 

Here, we are looking for asymptotic stability with respect to the equilibrium 
in question. This is a strong property which cannot in general be deduced from 
practical stability (guaranteed by general results on attractors in [6, 7] and [31]). In 
[3 1 ] (Chap. 5), several results for our problem focusing on specific classes of ODEs 
are derived using classical numerical stability concepts like A-stability, 5-stability, 
and the like. 

It should be emphasized that standard step size control algorithms do not solve 
problem (PI). The following example illustrates this point. 

Example 7.3.1 Consider the linear planar system 

ii = -0.005x1 +X2 i2 = -XI - 0.005x2 (7.22) 

Following the suggestions in [12] (pp. 167-169) based on the estimation of the local 
discretization error, we have used the formula 



^new = hmin 
where 




(7.23) 



err = 




2 



-^l.EULER — -«1,HEUn\ 1 /■«2,EULER — •^2,HEUn\ (■! 'yA\ 

SCl / 2\ SC2 / 

Rtolmax{|x,|, |x/,heun|} / = 1, 2 (7.25) 

Atol > is the tolerance for absolute errors, Rtol > is the tolerance for relative 
errors, f > 1 is a constant factor which determines the magnitude of a (possible) 
increase of the step size, x,- euler (' = 1, 2) are the approximations of the compo- 
nents of the solution by the explicit Euler scheme, and x,_heun (' = 1, 2) are the 
approximations of the components of the solution by Heun's 2nd-order scheme. 

Figure 7. 1 shows the logarithm of the value of the squared Euclidean norm for the 
numerical solution obtained by Heun's 2nd-order scheme with Atol — Rtol — 10~^, 
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Fig. 7.1 The value of the 
logarithm of the squared 
Euclidean norm 
V(f) = |.r(f)pforthe 
numerical solution of (7.22) 
with Atol = Rtol = 10"^ 
P = 2 
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Fig. 7.2 The value of the 
applied step size for the 
numerical solution of (7.22), 
with Atol = Rtol =10"^, 
P=2 
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Fig. 7.3 The phase portrait 
for the numerical solution of 
(7.22) with 
Atol = Rtol = 10-2, P = 2 




P — 2, and initial condition (x\,X2) — (1,0): the numerical solution exhibits an 
asymptotically stable limit cycle of radius r = 0.17195, which is clearly shown in 
the phase portrait in Fig. 7.3. Indeed, Fig. 7. 2 shows that the step size tends to take 
values inside the interval [0.347, 0.351] for large times. The limit cycle shrinks to 
the origin as Atol, Rtol -^ 0, but exists for all Atol, Rtol > 0. Figure 7.4 shows the 
logarithm of the value of the squared Euclidean norm for the numerical solution 
obtained by Heun's 2nd-order scheme with Atol — Rtol — 10~^, P — 2, and initial 
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Fig. 7.4 The value of the 
logarithm of the squared 
Euclidean norm 
V(f) = |.r(f)pforthe 
numerical solution of (7.22) 
withAtol = Rtol=10"^, 
P = 2 
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condition (xi, X2) — (1,0): the numerical solution exhibits an asymptotically stable 
limit cycle of radius r — 0.015. It is clear that (standard) step size control based on 
the local discretization error does not give the desired qualitative behavior. 



7.3.2 Small-Gain Methods 



Consider the following system described by ODEs: 

z = /o(z) 



x\ = -ai(xi)xi + /i(z) 
Xi ^-ai(xi)xi + /,(z,xi,. 
(xi,...,x„)'e9r, /o 



,Xi-l 



) i^2, 



(7.26) 



(7.27) 



where z e m"\ x = (xi, . . . , xj e m", /o : Sir -^ S){'", /i : 9J'" -^ m, fi : Or x 
!){'"' -^ ^i (i — 2, . . . , n), and a,- :?i\ ^>-'i)\ {i — \, . .. ,n) are locally Lipschitz map- 
pings with /o(0) = 0, /i (0) = ■ ■ ■ = /„ (0, 0, . . . , 0) = 0. We assume that there exist 
constants L,- > (/ = 1, . . . , m) such that 

ai{y)>Li VyeS){ (7.28) 

We also assume that e Dt™ is UGAS for (7.26). Under the previous assumptions, 
using the fact that system (7.26), (7.27) has a structure of systems in cascade, we 
can prove by induction that for every j — l,...,n,Oe 9J"' x W is UGAS for sys- 
tem (7.26) with 

x\ = -ai(xi)xi + /i(z) 

i/ = -a,(x,)x/ + /;(z,xi,...,Xi_i) (=2, ...,;■ (7.29) 

The proof is based on the fact that for every x,_o e !W and for every measurable 
M : SH"*" -^ S){, the solution of x, — —ai(xi)xi + u with initial condition x,(0) — xjq 
satisfies the following estimate, which is obtained from the variations of constants 
formula and (7.28): 



x,-(0 <exp 



l^f.Ol 



1 I I 

— sup \u{s)\ 

'^i 0<s<f 



Vf >0 



(7.30) 
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Consequently, the solution of i,- — —ai(xi)xi + fi(z,xi, . . . , x,_i) satisfies |x,(r)| < 
exp(-^r)|x;.o| + ;^supo<^<J/,(z(5),xi(5),...,x,_i(5))|- Using the functions 
Vi(z,x) = |z|, y,+i('z,x) = \xi\ (/ = l,...,n) and the set S{t) := iH"' x M", one 
can show that hypotheses (SG3), (SG4), and (SG5) hold for system (7.26), (7.27) 
with gains yijis) (i, j — 1, . . . ,n + 1) satisfying yijis) = for j > i. Therefore, 
the cyclic small-gain conditions hold, and Theorem 5.2 guarantees UGAS for sys- 
tem (7.26), (7.27). 

Suppose that a stable numerical scheme is available for (7.26), i.e., there exist 
(p e C°{dr; (0, r]), r > 0, and Fq : U,sm'" ([0- V(z)] x {z}) -^ S)^ with Fo(h, 0) = 
for all h e [0, (p(Q)] and lim,,^o+ Fo(h, z) = /o(z) for all z e di"" such that e m'" 
is URGAS for the hybrid system 

z{t)^Fo{hi,z(ri)) f e[T;,T,+i) 

to — 0, r/+i — Xi + hi 

hi = ^(z(t,)) exp(-M(r,)) 

x(0e9f{",M(0e[0,+oo) (7.31) 

We propose the following first-order numerical scheme for (7.27): 

XI (r + /i) = XI (0 - hai (xi (r))xi {t + h) + hfi (z(f )) 

Xi(t + h)^ Xi(t) - hai{xi(t))xi(t + h) + hfi{z(t),xi(t), ..., x,_i(f)) 

i^2,...,n (7.32) 

The above scheme is a partitioned scheme which treats differently the state x, and 
the states z, xi , . . . , x,_i for each differential equation. The resulting hybrid system 
is system (7.31) with 

. -ai(xi(r,)) 1 r f , .\ 

l + /!,ai(xi(r,)) l + /z,ai(xi(T,)) 

■ r.^ -a/(^/(r,)) 
x,(n = ^ — Xj(ri) 

1 , , 

■./)(z(r,),xi(T,),...,xj_i(r,)j 



1 +hiaj{xj(xi))' 
j^2,...,n (7.33) 

We have 

Theorem 7.2 e Sir x !){" is URGAS for system (7.31), (7.33). 

The proof of the above theorem is based on the following technical lemma. 

Lemma 7.1 Let a : SR — >• [R iie a continuous function with L — infygaj a{y) > 0, and 
let a constant r > 0. Then for every sequence {/i;}^ with hi e (0, r] for all i > 0, 
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for every locally bounded function v : Dt"*" — >• S){, and for every xq e S)i, the solution 
of 

1 

-vixi) f e[r,-,T,+i) 



-a(x(r,)) 



1 + hia{x{xi)) 1 + hia{x{xi)) 

T;+i = Xi + /!,■ , /z,- e (0, r], x(f ) e Df{ (7.34) 

w/?/; initial condition x(0) = xq € !){, tq = satisfies the following estimate: 

II 1 I I r \ 

|x(f) I < exp(CTr)|xo| exp(— erf) H sup pC^)! Vre 0, supt/l (7.35) 

where a > is any constant such that -rr- < exp(— cr^) for all s e [0, rL\, i.e., 

ln(l+^ 
— rL 

Proof Notice that for every / > 0, it holds that 

x{xi+\) = -^0 ]~[(1 + hja{x{xj)))~ 



i 

E 



\k=j 



(7.36) 



and using the definition L — infygjn «(}>) > 0, we obtain the following bound 
from (7.36): 



\x(xi+i)\<\xo\Y[{l+hjL)-^ 



,/=o 



+ max |ii(T;)|y^ 
/=o,...,/' ' ^—i 

7=0 



hjlY[(i+''kLr'\ 

Let fj > such that j^ < exp(— a^) for all s e [0, rL]. It holds 

/ i 

]~[(1 + hjL)~^ < Yl exp(-aLhj) = exp(-CTLT,+i) 

7=0 ,/=0 



and 



i 


/!/(n(i+/!^i)"M 


i 


7=0 


L V=; /J 


j=o 



hj I ]~[ exp(-aL/?^) 



(7.37) 



^[/i; exp(-crL(T,+i - T,))] 



7=0 

/ 
= exp(-o-Lr,+i)^ 

7=0 



exp( 



aLxj) f 

Jx 



'^i+l 



ds 
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/" 



exp(aLs)ds 



<exp(-crLr/+i)^ 
./=o 

= exp(— aLr,_|_i) / exp(aLs)ds 
Jo 

1 
< — 

~ ctL 

Using the above inequalities in conjunction with (7.37), we obtain, for all / > 0, 

II 1 I I 

\xiri+i)\ < |xo|exp(-crT/+i)H max \v{rj)\ (7.38) 

a L Q<j<i 

Now, for all ; > and f e [t; , t,+i), it holds that 

|x(f)|<max{|x(r,-)|,|x(r,+i)|} (7.39) 

Combining (7.38) and (7.39) finishes the proof. D 

The proof of the Theorem 7.2 follows from Lemma 7.1, which guarantees that 
\xi(t)\ < exp(CTr)|x,(0)|exp(-CTO + ^ supo<j<, |//(z(i), . . . ,x,_i(i))|, where 

(T e (o /"(i+'-^) ). Using the functions Viiz,x) = \z\, V,+i(z,x) = \xi\ (i = 
1, . . . , n), and the set S{t) := Sit'" x St", one can show that hypotheses (SG3), (SG4), 
and (SG5) hold for system (7.31), (7.33) with gains y;j (s) (i, j — I, . . . ,n + 1) sat- 
isfying yij(s) = for j > /. Therefore, the cyclic small-gain conditions hold, and 
Theorem 5.2 guarantees URGAS for system (7.31), (7.33). 

Example 7.3.2 Consider the infinite-dimensional dynamical system described by 
PDEs 

— (r, z) + c—(t, z) = b{x(t, z))x(t, z) z e (0, 1] 
dt dz 

x(f,0) = (7.40) 

with x(t, z) ef}i,b:d{^>- di being locally Lipschitz, c > 0, and initial condition 
x(0, z) = xo(z), where xq e C\[0, 1]; 9J) with xo(0) = '^(0) = 0, under the fol- 
lowing hypothesis: 

(H) There exists a constant K >0 such that b(x) < K for all x edl. 

Using the method of characteristics and hypothesis (H), it can be shown that 
the infinite-dimensional dynamical system (7.40) admits a unique classical solution 
x(t, ■) e CH[0, 1]; m) with x(t, 0) = |f (f, 0) = for all t > 0. Moreover, the zero 
solution is globally asymptotically stable, since for every xq e C^([0, 1]; S){) with 
xo(0) = ^(0) = 0, the unique classical solution x(t, ■) e €^[0, 1]; m) of (7.40) 
with initial condition x(0, z) = xo(z) satisfies x(t, z) — for all t > c~^z (uniform 
global attractivity). 

Using a uniform space grid of n + 1 points with space discretization step Az — -, 
setting Xi{t) — x(t, iAz), i —0,1, . . . ,n, and approximating the spatial derivative 
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by the backward difference scheme |f (t, iAz) ^ ^('■'^^)-^(^('-i)^z) ^ ^-(0-^-i(0 
for ; = 1, . . . , M, we obtain the following set of ordinary differential equations: 

il = -( — b{xi)\xi 

(7.41) 
c \ c 

b{xi)]xi + —-Xi-i i — 2,...,n 

,Az ) Az 

Clearly system (7.41) has the structure of system {1 .21) with ai{xi) — -^ — b{xi) 
for i — \, ... ,11. Moreover, if the space discretization step is selected so that 

KAz < c (7.42) 

where A" > is the constant involved in Hypothesis (H), then inequalities (7.28) 

hold as well with L: = 4 — A" for / = 1, . . . , m. Theorem 7.2 allows us to conclude 

that, for every h > 0, the numerical scheme 

XI (t) 
xi(t + h) 



l + h{^-b(xiit))) 

Xi(t)+j^Xi-l(t) 



(7.43) 



Xi (t + h) — -. ( — 2, 

i + h{^-bixiity)) 



will give the correct qualitative behavior. The reader should notice that for the case 
b{x) = 0, inequality (7.42) is automatically satisfied (with K — 0), and the numeri- 
cal scheme (7.43) is related to the so-called implicit upwind numerical scheme for 
the advection equation, which is unconditionally stable. 

Small-gain arguments can also be used for the system 

Xj = -a; (xi )xi + fi(x_i) i = 1 , . . . , n (7.44) 

where x e ?ft" , /,■ : !){"~^ -^ di, and a; : Dt ^- Dt (j = 1, . . . , n) are locally Lipschitz 
mappings with fi(0) — 0(i = l, . . . , w). Here x_,- — (xi, . . . ,x,_i, x,+i, . . . ,x„) for 
I < i < n and X-[ — (xj, . . . , x„), X-„ — (xi, . . . , x„_i). 

Assume the existence of constants L, > and Gij >0(i,j — l,...,n) such 
that 

ai (xi )>Li and I /,■ (x-i ) I < max G; / 1 jc^ | for all x e di" (7.45) 

./¥' 

Consider the following first-order numerical scheme for (7.44): 

Xi (t + h)^ Xi (t) - hat [xi (t))xi {t + h) + hft (x_; (f )) / = !,...,« (7.46) 
The resulting hybrid system with constant step-size selection is 

— fl;(X;(T,-)) 1 

l + hiajixjiXi)) l + hiaj(xj(ri)) 

t/+i = r, + hi 

hi =rexp(-M(r,)) 

jc(0eS1{",M(0e[0,+oo) (7.47) 

where r > 0. 
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Using Lemma 7.1 and Theorem 5.2, we are in a position to show the following: 

Theorem 7.3 e ^i" is URGAS for system (7.47), provided that for each p — 
2, ... ,n, it holds that 

'ln(l + rmax(Li, ...,L„))\'' 

rmax(Li, ...,L„) 

for all ij e {!,..., n}, ij / ik if j / k. 



..G,,,---G,,.,< — -— — ^--^ L,L,,---^, (7.48) 



Indeed, Lemma 7.1, in conjunction with (7.45), implies that, for all / = 1, ... , n, 
the following estimates hold: 

II II 1 II 

\xi(t)\<e\p((7r)\xi{0)\e\p(—at)-\ maxG,-,/ sup |jc/(i')| Vf > 

with a = '"^rmaxa!^'"/,;^""'^ - Using the functions Vi(x) = |x,| (/ = 1, . . . , «) and 
the set S(t) := di", one can show that hypotheses (SG3), (SG4), and (SG5) hold for 

system (7.47) with gains yi^j(s) := (1 + £) ina+r^x(Li[Zt"y)L, ^ foralle > 0, (, j = 
1, . . . , n, / ^ j, and yijis) = for i = 1, . . . , n. Therefore, by (7.48) the cyclic 
small-gain conditions hold for sufficiently small e > 0, and Theorem 5.2 guarantees 
UGAS for system (7.47). 
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In this section, we study the discrete-time model 

x(f + 1) = 1 - fi{x(t)) - f2{x(t), y(t), u(t)) 
yit+l)^y(t)-f2{x(t),y(t),uit)) 

{x(t), y(t)) e (0, +oo) X [0, C3], u(t) e m (7.49) 

where 

/i(x) :— r maxjO; min(c2; x — ci)} 

f2(x, y, u) := min{j; maxJM; y - cy, -/i(x)}} 

and Ci > (i — 1,2,3), r e (0, Cj ), and ci < 1 are constants. The discrete-time 
model (7.49) is an equivalent form of model (1.123) studied in Example 1.7.1 in 
Chap. 1 and expresses the evolution of the price of a certain commodity in a com- 
pletely competitive market under the intervention of the government (buffer stocks). 
Notice that /2(x, 3;, 0) = for all (x, y) e (0, +cxd) x [0, C3]. There exists an equi- 
librium set for the case m (f ) = given by 

(x , y) ^ (xeq, y) 

where y e [0, C3] is arbitrary, and 

f -t±^ if ci + C2 > 1 - C2r 
xeq= '+'■ (7.50) 

I 1 — C2r if ci -h C2 < 1 — C2r 
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The variable u{t) is directly related, by means of (1.121), to the quantity of the 
commodity released to the market by the government at period / + 1 and is the 
control input of the system (i.e., u (t) can be manipulated in order to achieve a certain 
control objective). 

We next state the tracking control problem for (7.49). 

The tracking control problem for (7.49) Let x* > be the desired price. Is there a 
static feedback law (or price stabilization policy) 

u{t) = cp{x(t),y(t)) (7.51) 

such that the solution of the closed-loop system (7.49) with (7.51) satisfies 
limf_j.+oo -^CO = X* for all initial conditions (x(0), ^(0)) e (0, +oo) x [0, C3]? 

The following proposition provides an answer to the tracking control problem. 

Proposition 7.1 (Necessary Condition for solvability of the tracking control prob- 
lem for (7.49)) If the tracking control problem for (7.49) is solvable, then the fol- 
lowing condition must hold: 



where Xeq is the equilibrium price defined by (7.50). 

Proof By virtue of (7.49) and the continuity of the function /i, it follows that the 
limit limr^+oo fiixit), y(t), (p(x(t), yit))) exists and is given by 

The above equality implies that \im,^+oo(y(t -I- 1) — y(t)) — x* — I — fi(x*). If 
X* — \ — f\{x*) > 0, then we obtain lim,^-|_oo y(t) — +00, which contradicts the 
constraint y(t) e [0, C3]. On the other hand, if x* — 1 — fi(x*) < 0, then we obtain 
lim,^_i_oo yit) — —00, which again contradicts the constraint y{t) e [0, C3]. Thus, 
we must necessarily have x* — I — fi{x*) — 0, and consequently the desired price 
X* > coincides with Xgq, the unique equilibrium price defined by (7.50). The proof 
is complete. D 

Proposition 7.1 indicates a major limitation imposed by the use of buffer stocks: 
the price dynamics can only have a unique accumulation point, which is no other 
than the equilibrium price. This important limitation may be used to explain the 
failure of buffer stock stabilization policies: if the government tries to lead the com- 
modity price to values different from the equilibrium values, the buffer stock stabi- 
lization policy (no matter how smart) will fail. 

Since the desired price must coincide with the equilibrium price, we may state 
next the price stabilization problem for (7.49). 

The price stabilization problem for (7.49) Is there a static feedback law (or price 
stabilization policy) given by (7.51) with ^(xgq, 3') = for all y e [0, C3] such that 
the closed-loop system (7.49) with (7.51) and output F = x - Xeq is URGAOS? 
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The price stabilization problem is particularly interesting when ci + C2 > 1 — C2r 
and r > 1: Example 2.8.2 in Chap. 2 showed us that in any other case system (7.49) 
with M = and output Y — x — Xgq is URGAOS. 

Solution of the Price Stabilization Problem for (7.49) Set 

M(0=l-xeq-/i(x(0) (7.52) 

or equivalently, in the original coordinates (system (1.120)), 

G(t) = min{ Qit); maxjSeq - g(P(0); 2(0 - emax}} (7.53) 

where S^q is the equilibrium supply that corresponds to the equilibrium price f eq — 

a+c 
d+b' 



^^i^, and g{P{t)) is the estimated commodity supply for the period t + I. 



The feedback law described by (7.52), (7.53) is particularly simple and attempts 
to bring the total quantity of the product available in the market at period t + 1 
(given by S(t + 1) + G(t)) as close as possible to the equilibrium supply S'eq. For 
this reason, we call this price stabilization policy as: "Keep Supply at Equilibrium" 
(KSE) price stabilization policy. 

Proposition 7.2 (Conditions for successful KSE policy) Consider the price stabi- 
lization problem for (7.49) under the hypotheses ci + C2 > 1 — cjr and r > I. If 
C3 > /?, where 

R : = max{/?i; R2; R3; R4] (7.54) 

Ri :=min{(l -r~^)(l -Xeq); ci+C2r - l} 

Ri := ('" - l)min{xeq - ci; ci + C2 - Xeq} > (7.55) 

Rt, :— minjci + C2r — 1; 1 — ci — C2] 

Ra := (r + 1)"^ min{r(xeq + czr - 1); (r - l)(ci + cz + C2r - 1)} 

then the closed-loop system (7.49) with (7.52) and output Y — x — Xeq is URGAOS. 
Particularly, there exists T > such that for every initial condition (x(0), ^(0)) € 
(0, +CX3) X [0, C3], the solution of the closed-loop system (7.49) with (7.52) satisfies 

x(f) = xeq Vf>r (7.56) 

We call the quantity aR, where a > is the constant involved in (1.114), the 
"critical storage capability T Clearly, Proposition 7.2 guarantees that if the stor- 
age capability is larger than the critical storage capability, i.e., Qmax > ciR^ where 
Gmax is the maximum storage capability involved in (1 . 1 1 1), then the "Keep Supply 
at Equilibrium" (KSE) policy is successful. Moreover, the critical storage capabil- 
ity can be computed analytically using (7.54), (7.55). The conclusions of Proposi- 
tion 7.2 may be used in order to calculate the storage cost needed for a successful 
buffer stock stabilization policy (since the storage cost is directly related to the stor- 
age capability Qmax) and determine whether the cost of the buffer stock stabilization 
policy is high or not. Notice that the result of Proposition 7.2 may be interpreted as 
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a trade off between the efficiency of the price stabihzation poUcy and the storage 
cost. It should be noted here that the total cost of the buffer stock stabilization pol- 
icy includes also the purchase cost, i.e., the cost of purchasing quantities of the 
commodity. 

Proposition 7.2 provides the sharpest characterization of the property of global 
attractivity of the equilibrium point under the feedback law (7.52). Indeed, 

• if < C3 < 7?3, then a nontrivial period-2 solution exists: 

(x[,yi)^(l -C2r + Ci,Ci) 
fe,}'2) = (l-C3,0), 

• if < cj < R2, then a nontrivial period-2 solution exists: 

(Xl,yi) = {xeq- (r - l)"'c3,C3) 
fe,y2) = (^eq+('--l)"'c3,0), 

• if max{0; c\ + rc2 — 1} < C3 < R4, then a nontrivial period-2 solution exists: 

(Xl,yi)^ (1 -C2r + C3,C3) 

(X2,y2) — (1 +rci —r + r^C2 - C3 -rc3,0), 

• if maxjO; 1 — ci — C2} < C3 < /?i, then a nontrivial period-2 solution exists: 

(xi,yi) = (l-C3,0) 

(X2, yi) = (1 + A-ci - r + C3 + rc3, C3). 

A final remark for the tracking control problem for (7.49) must be given. Proposi- 
tion 7.1 showed a major limitation of the buffer stock stabilization policy. However, 
if government is allowed to change the tax coefficient of the commodity, then the 
equilibrium price changes and can coincide with the desired price x* . Then the KSE 
buffer stock policy may be used to stabilize the price dynamics. Thus, we conclude 
that the tracking control problem for (7.49) is indeed solvable by making simulta- 
neous use of appropriate tax and buffer stock policies. 

The proof of Proposition 7.2 is based on the spirit of Lemma 6.8 in Chap. 6, 
where the "dead-beat" property was achieved. 

Proof of Proposition 7.2 Notice that 

/2(x, y, 1 - Xeq - /i(x)) = mm[y\ maxjy - C3; 1 - Xeq - /i(x)}} 

1 - f\ix) - flix, y, 1 - Xeq - /i(x)) 

i - fl(x) - y + Ci if y + /i (x) > 1 - Xeq + C3 

Xeq if 1 - Xeq < >> + f[ (x) < 1 - Xgq -|- C3 

i-fl(x)-y ify + /l(x) < 1 -Xeq 
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y- f2{x,y, 1 

C3 



ify + /l(x)>l 



^eq 



-C3 



^eq 



/iW = 



y-l+Xeq + fl(x) if 1 - Xeq < 3^ + /l (x) < 1 

if>' + /i(jc)<l 

ifx<ci 

—cir + rx if ci < X < ci + C2 

C2r if X > ci + C2 



^eq 



•C3 



Making use of the above equalities in conjunction with hypotheses y{t) e [0, C3], 
c\ + C2> I — C2r, and r > 1, it can be shown that 



x(t +l)—l + cir -rx(t) + C3- y(t) and y(t + l) 
if {x(t),y(t)) eBi -.^{x^q + r-^cs-y) <x <ci + 

x(f + 1)= l-C2/- + C3-3/(0 and y(t+l)^c3 
if (x(t), y(t)) e B2 '■— {x >ci + C2 and y > 1 — Xgq + 

x(t+l)^l-y(t) and y(t+ 1)^0 

if (x(0, y(f)) e B3 := {0 < X < ci and y < 1 - Xeq} 

x(t +l)—l + cir - rx(t) - y(t) and ^(f + 1) = 



:C3 



C2 



C3 — ^2^} 



if(x(0,y(0)e54 

x(f + l) = Xeq 



{Cl < X < Xeq 



^} 



if (x(f), y(0) e B5 = (0, +(») X [0, C3]\ ( U ^M- 

Moreover, since ci + C2 > 1 — C2r which directly implies ci < Xeq < ci 
that Cl < 1), the following implications hold: 



{x(t),y(t))eBiUB2 

{x(t),y(t))eBiUB4 

{x(t(i),yito)) eBs 



{x(t + 1), y(t + 1)) e 53 U 54 U 55 
(x(?+l),y(f+l))e5iU52UB5 
xCO^-^eq Vr>ro + l 



(7.57) 


(7.58) 


(7.59) 


(7.60) 


(7.61) 


C2 (notice 


(7.62) 


(7.63) 


(7.64) 



In order to show (7.56), it suffices to show that for every initial condition 
(x(0), :v(0)) e (0, +00) X [0, C3], it holds that {x(T), y(T)) e B5, where 



r = 2 



1 



''eq 



min{c3r 



; Cl + C2 ■ 



^eql 



and 5 > is to be selected. 

The proof will be made by contradiction. Suppose on the contrary that there ex- 
ists initial condition (x(0), ^(O)) ^ B5 such that (x(r), y{t)) ^ B5 for all t e [0, T]. 
Without loss of generality, we may assume that (x(0), ^(0)) e B[ U B2 (since if 
(x(0), ^(0)) e B3 U 54, then by (7.63) we would have (x(l), y{l)) e BiU B2 and 
then consider the solution with initial condition (x(l), ^(1)) e B[ U B2, which also 
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satisfies (x{t), y(t)) ^ B5 for all t e [0,T — 1]). By virtue of implications (7.62) 
and (7.63), we must have 

(x(t), y(t)) e BiU B2 if f is even and 

(7.65) 
{x(t),y(t)) eB3UB4 if r is odd 

Moreover, by virtue of (7.57), (7.58), (7.59), and (7.60), we obtain 

y(t) — if f e [1, r] iseven and 

(7.66) 
y(t)^C3 iff e [1,7] is odd 

By virtue of (7.57), (7.58), (7.59), (7.60), (7.65), and (7.66), we must also have 

Xeq< Xsq + n\m{c3r~ ; ci+ C2 — Xeq] < x(t) if f e [2, r] is even. (7.67) 

Next, we show that there exists S > such that 

x(t + 2)<x(t)-S for all even integers r e [2, r] (7.68) 

Thus, we obtain a contradiction, since (7.67), in conjunction with (7.68) and the fact 
that x(f) < 1 for all t e [1, T], gives Xeq + minf car"'; ci +C2 — Xeq} < x(2 + 2^) < 
1 — kS for all integers k>l with 2^ + 2 < T, which cannot hold for^> 1 + ^~'[1 — 

Xeq - min{C3r~'; Cl + C2 - ^eq}]- 

Consequently, the rest part of the proof is devoted to the determination of the 
constant S > that satisfies (7.68). For all (x(f ), 0) e Bi U B2, it can be shown that 



Case I: If Xeq + r~ (x^q + c^ — c\) < x(t) < ci + C2 and C3 < 1 — jCeq, then 
jc(f + 2) = 1 -C3. 

'^eq 



Case II: If jCeq + (r + l)r ^C3 < x(t) < ci + min{c2; r '(1 + C3 — c\)}, then 



x(t + 2) —Xeq + r^{x(t) -Xeq) - {r + 1)C3. 

Case III: If x(t) > ci + C2 and C3 < 1 — x^q and C3 < ci + C2r — 1, then x(t + 2) = 

I-C3. 
Case IV: If x(f) >ci+C2 and ci + C2r — 1 < C3 < r(r + l)~n-'^eq + C2r — 1), then 

x{t + 2) = 1 + cir - r + C2r^ - {r + l)c3. 
Case V: If none of the above holds, then x(t + 2) — x^q. 

In Case I (i.e., if C3 < 1 — x^q and C3 < ci + rc2 — 1) by virtue of the inequality 
C3 > 7?i, we must necessarily have C3 > (1 —r~')(l —Xgq), and consequently (7.68) 
holds with ^ := (1 + r"')(jt:eq + C3) - (1 + r"'ci) > 0. 

InCaseII(i.e., if C3 < r(xeq — ci) andc3 < r^(r+ l)~'(ci +C2 —Xeq)) by virtue 
of the inequality C3 > R2, we must necessarily have C3 > (r — 1) minjxeq — ci; ci + 
C2 — Xeq}, and therefore (7.68) holds with S — (I + r)[c3 — (r — l)min{ci + C2 — 

Xeq, Cl + /-"Hi + C3 - Cl) - Xeq}] > 0. 

In Case III (i.e., if C3 < 1 — Xeq and C3 < ci + rc2 — 1) by virtue of the inequality 
C3 > R3, we must necessarily have C3 > 1 — ci — C2, and consequently (7.68) holds 
with (5 := Cl + C2 + C3 — 1 > 0. 

In Case IV (i.e., if ci + C2r — 1 < C3 < r(r + l)~'(-^eq + '^2'" — 1)) by virtue of 
the inequality C3 > R4, we must necessarily have C3 > (r — l)(r + 1)~' (ci + C2 + 
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C2r — 1), and consequently (7.68) holds with 5 := (1 + r)c^ + (r — 1)(1 — ci — 
C2 - C2r) > 0. 

The constant S > that satisfies (7.68) can be selected as the minimum of the cor- 
responding constants given for each case. Thus property (7.56) is proved. The fact 
that the closed-loop system (7.49) with (7.52) and output F = x - Xeq is URGAOS 
follows from Lemmas 1.3, 1.4 in Chap. 1 and Lemmas 2.1 and 2.2 in Chap. 2. 

The proof is complete. D 



7.5 Historical and Bibliographical Notes 

1 . There are many results dealing with the stabilization of chemostat models (see 
[1, 3, 5, 14, 17, 19-21, 25, 28, 29] also see [26, 27]). Delayed chemostat models 
have been studied primarily for their dynamic behavior (see [30, 32, 33]). The 
results in Sect. 7.2 first appeared in [19]. 

2. The conversion of the problem of the correct dynamic behavior of the numerical 
approximation to a rigorous feedback stabilization problem was first given in 
[16]. Lyapunov methods for the solution of the feedback design problem can be 
used as well (see [18], where many more results are presented). 

3. The results in Sect. 7.4 first appeared in [2]. However, the reader should notice 
that the conclusion of Proposition 7.2 is slightly stronger than the conclusion of 
Proposition 3.2 in [2]. 
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Chapter 8 
Open Problems 



In this chapter, we would like to give a list of open and unanswered problems in 
Mathematical Control Theory. The solutions of these open problems will be very 
important for the development of modern nonlinear control theory. Expectedly novel 
mathematical analysis and synthesis tools need to be developed to address these 
challenging problems. The interested reader should also consult the book [3] for 
other significant and important open problems in Mathematical Control Theory. 

Open Problem #1 Under what conditions WIOS implies lOS? 

A qualitative characterization of the lOS property for abstract control systems as 
discussed in this book has not been available yet. For systems described by ODEs, 
many qualitative characterizations of the ISS and lOS properties are provided in 
[21-23]. Moreover, Theorem 4.1 in Chap. 4 gives a complete qualitative character- 
ization of the WIOS property: 

'"O-GAOS" + ''RFC" + "the continuity with respect to initial conditions and 
external inputs" implies WIOS 

A similar qualitative characterization for the lOS property in a general context 
of abstract dynamical systems as discussed in this book will be very important for 
control designs and applications. 

Open Problem #2 Development of small-gain techniques for dynamical systems 
described by Partial Differential Equations (PDEs). 

Small-gain results have been well studied for finite-dimensional nonlinear sys- 
tems described by ordinary differential, or difference, equations (see, e.g., [8-10] 
and references therein). However, as of today, there is little research devoted to the 
development of small-gain techniques for nonlinear systems described by Partial 
Differential Equations (PDEs). We believe that the small-gain results provided in 
the present book (Theorems 5.1 and 5.2 in Chap. 5) will pave the road for the appli- 
cation of small-gain results to systems described by PDEs. 
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Open Problem #3 Formulas for the Coron-Rosier methodology. 

Theorem 6. 1 in Chap. 6 is an existence-type result. Although its proof is con- 
structive, it cannot be easily applied for feedback design purposes. The creation of 
formulas for the Coron-Rosier approach will be very significant for control pur- 
poses, since the Coron-Rosier approach can allow nonconvex control sets and does 
not require additional properties for the Control Lyapunov Function. The signifi- 
cance of the solution of this open problem is also noted in [5]. 

Open Problem #4 When is a nonlinear, time-varying, time-delay system stabiliz- 
able ? 

We have recently provided a positive answer to the above question when the sys- 
tem only involves state-delay [13]. A complete answer to the question of when the 
nonlinear time-varying system with both state and input delays is stabilizable re- 
mains open and requires deeper investigation. Nonetheless, it should be mentioned 
that sufficient, but not necessary, conditions for the solution of the stabilization prob- 
lem with input delays are proposed in the recent work of Krstic [14-16] (also see 
[11]). To our knowledge, a necessary and sufficient condition for stabilizability is 
missing even for linear time- varying systems with input delays. 

Open Problem #5 Application of small-gain results for distributed feedback design 
of large-scale nonlinear systems. 

Large-scale systems are abundant in various fields of science and engineering 
and have gained increasing attention due to emerging engineering and biomedical 
applications. Examples of these applications are from smart grids with green and re- 
newable energy sources, modern transportation networks, and biological networks. 
There has been some success with the use of decentralized control strategy for both 
linear and nonlinear large-scale systems; see [7, 19] and many references therein. 
Clearly more remains to be accomplished in this exciting field. We feel that small- 
gain is a very appropriate tool for addressing some of these modern-day challenges. 
The small-gain results of the present book (Theorems 5.1 and 5.2 in Chap. 5) make 
a preliminary step forward toward studying some complex large-scale systems be- 
yond the past literature of decentralized systems and control. 

Open Problem #6 Extension of the discretization approach for autonomous sys- 
tems. 

The discretization approach for Lyapunov functionals was described in Chap. 2 
(Propositions 2.4 and 2.5). However, as remarked in Chap. 2, the discretization ap- 
proach requires good knowledge of some approximation of the solution map, and 
its use has been restricted to time-varying systems with special structure (see [1, 17, 
18]). An extension of the discretization approach for autonomous systems would 
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be an important contribution in stability theory because such a result would al- 
low the use of positive definite functions with non sign-definite derivative. The re- 
quired extension of the discretization approach must utilize appropriate differential 
inequalities in the same spirit as the classical Lyapunov's approach (without requir- 
ing knowledge of the solution map or a system with special structure). The recent 
work in [12] is an attempt in this research direction (see also references therein). 
However, the problem is still completely "untouched." 

Open Problem #7 Application of feedback design methodologies to other mathe- 
matical problems. 

In this book, we have seen the applications of certain tools of modern nonlinear 
control theory to problems arising from mathematics and economics. Particularly, 
we have seen 

• applications of small-gain results to game theory (see Sect. 5.5 in Chap. 5), 

• applications to numerical analysis (see Sect. 7.3). 

We believe that feedback design methodologies can be applied with success to 
other areas of mathematical sciences. Fixed Point Theory (see [6]) and Optimization 
Theory can be benefited by the application of certain tools of modern nonlinear con- 
trol theory. Corollary 5.4 in Chap. 5 already shows that small-gain results can have 
serious consequences in Fixed Point Theory. Further connections between Fixed 
Point Theory and Stability Theory are provided by the work of Burton (see [4] and 
references therein) but are in the opposite direction from what we propose, that is, 
the work of Burton applies results from Fixed Point Theory to Stability Theory. 

The efforts for the solution of problems in Game Theory, Numerical Analysis, 
Fixed Point Theory, and Optimization Theory will necessarily demand the creation 
of novel results in stability theory and feedback stabilization theory. Therefore, the 
application of modern nonlinear control theory to other areas of applied mathe- 
matics will result to a "knowledge feedback mechanism" between Mathematical 
Control Theory and other areas in mathematics! 

Open Problem #8 Integral input-to-state stability (for short, iISS) in complex dy- 
namical systems. 

The external stability results of this book are exclusively targeted at extensions of 
Sontag's ISS property and its variants to a very general context of complex dynamic 
systems. That is, we want to address a wide class of dynamical systems which may 
not satisfy the semigroup property, motivated by important examples of hybrid sys- 
tems, switched systems, and time-delay systems. It remains an open and important, 
but interesting, question to know how much we could do with the iISS property 
introduced in [2, 20]. 
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